Jun 29 02:53:36 devstack cinder-volume[82031]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 02:53:36 devstack cinder-volume[82031]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 02:53:36 devstack cinder-volume[82031]: we strongly recommend against using it for new projects. Jun 29 02:53:36 devstack cinder-volume[82031]: If you are already using Eventlet, we recommend migrating to a different Jun 29 02:53:36 devstack cinder-volume[82031]: framework. For more detail see Jun 29 02:53:36 devstack cinder-volume[82031]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 02:53:36 devstack cinder-volume[82031]: import eventlet # noqa Jun 29 02:53:39 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:53:39 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:53:39 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:53:39 devstack cinder-volume[82031]: INFO dbcounter [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Registered counter for database cinder Jun 29 02:53:39 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:53:40 devstack cinder-volume[82031]: DEBUG dbcounter [-] [82031] Writer thread running {{(pid=82031) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 02:53:40 devstack cinder-volume[82031]: INFO cinder.rpc [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 02:53:40 devstack cinder-volume[82031]: INFO cinder.rpc [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 02:53:40 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:53:40 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Determined volume DB was empty at startup. Jun 29 02:53:40 devstack cinder-volume[82031]: DEBUG cinder.volume.manager [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82031) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 02:53:40 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 29 02:53:40 devstack cinder-volume[82031]: WARNING stevedore.named [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 02:53:40 devstack cinder-volume[82031]: WARNING castellan.key_manager [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:53:40 devstack cinder-volume[82031]: WARNING cinder.keymgr.conf_key_mgr [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:53:40 devstack cinder-volume[82031]: DEBUG cinder.volume.drivers.lvm [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82031) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 29 02:53:40 devstack cinder-volume[82031]: DEBUG oslo_concurrency.processutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82031) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_concurrency.processutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] CMD "cinder-rtstool verify" returned: 0 in 0.497s {{(pid=82031) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:53:41 devstack cinder-volume[82031]: INFO cinder.rpc [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 29 02:53:41 devstack cinder-volume[82031]: INFO cinder.rpc [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 29 02:53:41 devstack cinder-volume[82031]: WARNING stevedore.named [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 02:53:41 devstack cinder-volume[82031]: WARNING castellan.key_manager [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:53:41 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:53:41 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Starting 1 workers Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Started child 82201 {{(pid=82031) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Full set of CONF: {{(pid=82031) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] ******************************************************************************** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Configuration options gathered from: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] ================================================================================ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] allow_availability_zone_fallback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] allow_compression_on_image_upload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82201]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] allowed_direct_url_schemes = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] api_rate_limit = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] auth_strategy = keystone {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] az_cache_duration = 3600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_host = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_stats_polling_interval = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backup_api_class = cinder.backup.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backup_name_template = backup-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backup_use_same_host = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backup_use_temp_snapshot = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] chap_username = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_internal_tenant_project_id = 8c0df30d997d43f3a9c3a2f840c28605 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_internal_tenant_user_id = 1dc03a8a5a014a368e5dcae19c42ec1f {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cloned_volume_same_az = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cluster = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] compression_format = gzip {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] compute_api_class = cinder.compute.nova.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] config_dir = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] config_source = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] control_exchange = openstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] debug = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] default_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] default_group_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] default_volume_type = lvmdriver-1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] driver_ssl_cert_verify = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] driver_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] enable_force_upload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] enable_new_services = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] enable_unsupported_driver = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] enforce_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_api_insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_api_ssl_compression = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_ca_certificates_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_catalog_info = image:glance:publicURL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_num_retries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance_request_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] graceful_shutdown_timeout = 5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] group_api_class = cinder.group.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] host = devstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_compress_on_upload = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_conversion_address_space_limit = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_conversion_cpu_limit = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_conversion_disable = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_upload_use_cinder_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_upload_use_internal_tenant = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_volume_cache_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_volume_cache_max_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] image_volume_cache_max_size_gb = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] init_host_max_objects_retrieval = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] instance_format = [instance: %(uuid)s] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] iscsi_target_flags = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] iscsi_write_cache = on {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] iser_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] iser_ip_address = 192.168.122.153 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] iser_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_color = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_config_append = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_dir = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_options = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_rotate_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_rotate_interval_type = days {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82201]: INFO cinder.volume.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] log_rotation_type = none {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] max_age = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] max_logfile_count = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] max_logfile_size_mb = 200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] max_over_subscription_ratio = 20.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] message_reap_interval = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] message_ttl = 2592000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] migration_create_volume_timeout_secs = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] monkey_patch = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] monkey_patch_modules = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] my_ip = 192.168.122.153 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] no_snapshot_gb_quota = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] num_iser_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] num_shell_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] num_volume_device_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] nvmeof_conn_info_version = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] nvmet_ns_id = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] nvmet_port_id = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_max_limit = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_volume_ext_list = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_volume_listen_port = 8776 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_volume_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] osapi_volume_workers = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] per_volume_size_limit = -1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] periodic_fuzzy_delay = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] periodic_interval = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] public_endpoint = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] publish_errors = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_backup_gigabytes = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_backups = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_gigabytes = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_groups = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_snapshots = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] quota_volumes = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] rate_limit_burst = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] rate_limit_except_level = CRITICAL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] rate_limit_interval = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] reinit_driver_count = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] report_discard_supported = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] report_interval = 120 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] reservation_clean_interval = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] reservation_expire = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] reserved_image_namespaces = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] reserved_percentage = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] rpc_response_timeout = 120 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] run_external_periodic_tasks = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] scst_target_driver = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_down_time = 720 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] shell_completion = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] snapshot_name_template = snapshot-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] snapshot_same_host = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] state_path = /opt/stack/data/cinder {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] storage_availability_zone = nova {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] storage_protocol = iSCSI {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] syslog_log_facility = LOG_USER {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] target_helper = lioadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] target_ip_address = 192.168.122.153 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] target_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] target_protocol = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] target_secondary_ip_addresses = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] trace_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] transport_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] until_refresh = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_chap_auth = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_default_quota_class = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_journal = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_json = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_stderr = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] use_syslog = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] verify_glance_signatures = enabled {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_api_class = cinder.volume.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_clear = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_clear_size = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_copy_bps_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_dd_blocksize = 1M {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_name_template = volume-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack sudo[82205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_service_inithost_offload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volume_usage_audit_period = month {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] zoning_mode = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_concurrency.disable_process_locking = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack sudo[82205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.auth_type = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.auth_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.cache = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.include_service_catalog = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.interface = public {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_password = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcache_username = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.service_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.backend = dogpile.cache.null {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.backend_argument = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.backend_expiration_time = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.config_prefix = cache.oslo {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.debug_cache_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.enable_retry_client = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.enable_socket_keepalive = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.expiration_time = 600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.hashclient_retry_attempts = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_dead_retry = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_pool_maxsize = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_sasl_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.proxies = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.redis_db = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.redis_server = localhost:6379 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.retry_attempts = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.retry_delay = 0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.socket_keepalive_count = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.socket_keepalive_idle = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.socket_keepalive_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.socket_timeout = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.tls_allowed_ciphers = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.tls_cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.tls_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.tls_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.tls_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cache.username = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] coordination.backend_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.asyncio_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.asyncio_slave_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.backend = sqlalchemy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.connection_debug = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.connection_parameters = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.connection_recycle_time = 3600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.connection_trace = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.db_inc_retry_interval = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.db_max_retries = 20 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.db_max_retry_interval = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.db_retry_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.max_overflow = 50 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.max_pool_size = 5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.max_retries = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.mysql_wsrep_sync_wait = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.pool_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.retry_interval = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.slave_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.sqlite_synchronous = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.synchronous_reader = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] database.use_db_reconnect = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.connection_string = messaging:// {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.es_doc_type = notification {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.es_scroll_size = 10000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.es_scroll_time = 2m {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.filter_error_trace = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.hmac_keys = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.sentinel_service_name = mymaster {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.socket_timeout = 0.1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.trace_requests = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler.trace_sqlalchemy = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler_jaeger.process_tags = {} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler_jaeger.service_name_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] profiler_otlp.service_name_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.enforce_new_defaults = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: WARNING oslo_config.cfg [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.enforce_scope = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.policy_default_rule = default {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.policy_file = policy.yaml {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.group = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.helper_command = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] privsep_osbrick.user = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.group = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.helper_command = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] cinder_sys_admin.user = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.auth_type = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.send_service_user_token = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] service_user.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.auth_type = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] glance.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.chap_username = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.driver_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.extra_capabilities = {} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.iscsi_target_flags = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.iscsi_write_cache = on {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.iser_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.iser_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.lvm_share_target = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.lvm_type = auto {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.num_shell_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.report_discard_supported = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.reserved_percentage = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.target_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.target_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.target_protocol = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.trace_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.unique_fqdn_network = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.use_chap_auth = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_clear = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_clear_size = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_reports.file_event_handler = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_reports.log_dir = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.backend_host = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.chap_username = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.extra_capabilities = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.iser_helper = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.iser_ip_address = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.iser_port = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.lvm_share_target = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.lvm_type = auto {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.num_shell_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.report_discard_supported = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.reserved_percentage = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.scst_target_driver = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.storage_protocol = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.target_helper = lioadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.target_ip_address = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.target_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.trace_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.use_chap_auth = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_clear = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_clear_size = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] lvmdriver-1.volumes_dir = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_notifications.driver = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_notifications.retry = -1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] key_manager.fixed_key = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.barbican_api_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.barbican_endpoint = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.barbican_endpoint_type = public {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.barbican_region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.number_of_retries = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.retry_delay = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.send_service_user_token = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.verify_ssl = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican.verify_ssl_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.auth_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] barbican_service_user.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.approle_role_id = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.approle_secret_id = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.kv_mountpoint = secret {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.kv_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.kv_version = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.root_token_id = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.ssl_ca_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.timeout = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:53:41 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] ******************************************************************************** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 02:53:42 devstack sudo[82205]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:42 devstack sudo[82542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:42 devstack sudo[82542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:42 devstack sudo[82542]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.744s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 02:53:42 devstack cinder-volume[82201]: INFO cinder.brick.local_dev.lvm [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:42 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:42 devstack sudo[82764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:53:42 devstack sudo[82764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:43 devstack sudo[82764]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:43 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:43 devstack cinder-volume[82201]: DEBUG cinder.brick.local_dev.lvm [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82201) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 29 02:53:43 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:43 devstack sudo[82851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:43 devstack sudo[82851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:44 devstack sudo[82851]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:44 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.115s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:44 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:44 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:44 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:44 devstack sudo[82980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:44 devstack sudo[82980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:45 devstack sudo[82980]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:45 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:45 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:45 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:45 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:45 devstack sudo[82986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 29 02:53:45 devstack sudo[82986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:46 devstack sudo[82986]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:46 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.706s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:46 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:46 devstack sudo[82992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:53:46 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:46 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:46 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.787s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:46 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:47 devstack sudo[83002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:53:47 devstack sudo[83002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:47 devstack sudo[83002]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:47 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.802s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:47 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:47 devstack sudo[83008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:47 devstack sudo[83008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:48 devstack sudo[83008]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:48 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:48 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:48 devstack sudo[83012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:48 devstack sudo[83012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:49 devstack sudo[83012]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.682s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:49 devstack sudo[83021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:49 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:49 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.731s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:49 devstack cinder-volume[82201]: INFO cinder.volume.drivers.lvm [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:49 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:50 devstack sudo[83122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:50 devstack sudo[83122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:50 devstack sudo[83122]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:50 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:50 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:53:50 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:50 devstack sudo[83146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:53:50 devstack sudo[83146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:51 devstack sudo[83146]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:51 devstack cinder-volume[82031]: DEBUG dbcounter [-] [82031] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82031) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:53:51 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:51 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:51 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:51 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:51 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:51 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:51 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:51 devstack sudo[83291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:51 devstack sudo[83291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:52 devstack sudo[83291]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:52 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:52 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:52 devstack sudo[83294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:52 devstack sudo[83294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:53 devstack sudo[83294]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:53 devstack cinder-volume[82201]: INFO cinder.volume.driver [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Driver hasn't implemented _init_vendor_properties() Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG cinder.volume.driver [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82201) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG oslo_db.sqlalchemy.engines [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82201) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writer thread running {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG cinder.db.api [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Building query based on filter {{(pid=82201) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG cinder.image.image_utils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82201) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 02:53:53 devstack cinder-volume[82201]: INFO cinder.keymgr.migration [None req-52917a98-7d91-4ef6-8deb-0496fe8f74c6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:53 devstack sudo[83298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:53:53 devstack sudo[83298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:53 devstack sudo[83298]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:53 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:53 devstack sudo[83306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:53 devstack sudo[83306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:54 devstack sudo[83306]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:54 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:54 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:54 devstack sudo[83309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:54 devstack sudo[83309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:55 devstack sudo[83309]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:55 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.693s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:55 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:55 devstack sudo[83313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:55 devstack sudo[83313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:55 devstack sudo[83313]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:55 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:55 devstack cinder-volume[82201]: DEBUG cinder.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Notifying Schedulers of capabilities ... {{(pid=82201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:53:56 devstack cinder-volume[82201]: INFO cinder.volume.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Driver initialization completed successfully. Jun 29 02:53:56 devstack cinder-volume[82201]: INFO cinder.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Initiating service 2 cleanup Jun 29 02:53:56 devstack cinder-volume[82201]: INFO cinder.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Service 2 cleanup completed. Jun 29 02:53:56 devstack cinder-volume[82201]: DEBUG cinder.service [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Creating RPC server for service cinder-volume {{(pid=82201) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 02:53:56 devstack cinder-volume[82201]: DEBUG cinder.service [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82201) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 02:53:56 devstack cinder-volume[82201]: INFO cinder.volume.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 29 02:53:56 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:53:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:56 devstack sudo[83317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:53:56 devstack sudo[83317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:56 devstack sudo[83317]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:56 devstack sudo[83321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:56 devstack sudo[83321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:57 devstack sudo[83321]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:57 devstack sudo[83324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:53:57 devstack sudo[83324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:58 devstack sudo[83324]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.619s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:53:58 devstack sudo[83384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:53:58 devstack sudo[83384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:53:58 devstack sudo[83384]: pam_unix(sudo:session): session closed for user root Jun 29 02:53:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:53:58 devstack cinder-volume[82201]: INFO cinder.volume.manager [None req-12878103-55e8-4112-9c6e-ed38256dcbe8 None None] Driver post RPC initialization completed successfully. Jun 29 02:54:08 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:SELECT=2 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:54:08 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:54:56 devstack cinder-volume[82201]: DEBUG oslo_service.periodic_task [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:54:56 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:54:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:54:56 devstack sudo[85090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:54:56 devstack sudo[85090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:54:57 devstack sudo[85090]: pam_unix(sudo:session): session closed for user root Jun 29 02:54:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:54:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:54:57 devstack sudo[85093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:54:57 devstack sudo[85093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:54:58 devstack sudo[85093]: pam_unix(sudo:session): session closed for user root Jun 29 02:54:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:54:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:54:58 devstack sudo[85123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:54:58 devstack sudo[85123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:54:58 devstack sudo[85123]: pam_unix(sudo:session): session closed for user root Jun 29 02:54:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:54:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:54:58 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:54:58 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:54:59 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Jun 29 02:54:59 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:54:59 devstack cinder-volume[82201]: DEBUG cinder.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Notifying Schedulers of capabilities ... {{(pid=82201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:54:59 devstack cinder-volume[82201]: DEBUG oslo_service.periodic_task [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running periodic task VolumeManager._thread_info {{(pid=82201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:54:59 devstack cinder-volume[82201]: DEBUG cinder.volume.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] thread count: 6 {{(pid=82201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 02:54:59 devstack cinder-volume[82201]: DEBUG cinder.volume.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] thread info: [<_MainThread(MainThread, started 138776721358976)>, , , , , ] {{(pid=82201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 02:55:56 devstack cinder-volume[82201]: DEBUG oslo_service.periodic_task [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:55:56 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:55:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:55:56 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:55:56 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:55:57 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Jun 29 02:55:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:55:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:55:57 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:55:57 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:55:58 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Jun 29 02:55:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:55:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:55:58 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:55:58 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:55:58 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Jun 29 02:55:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.608s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:55:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:55:58 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:55:58 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:55:59 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Jun 29 02:55:59 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:55:59 devstack cinder-volume[82201]: DEBUG cinder.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Notifying Schedulers of capabilities ... {{(pid=82201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:56:08 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:SELECT=1 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:56:08 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:UPDATE=1 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:56:56 devstack cinder-volume[82201]: DEBUG oslo_service.periodic_task [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:56:56 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:56:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:56:56 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:56:56 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:56:57 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Jun 29 02:56:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:56:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:56:57 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:56:57 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:56:58 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Jun 29 02:56:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.745s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:56:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:56:58 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:56:58 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:56:58 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Jun 29 02:56:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:56:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:56:58 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:56:58 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:56:59 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Jun 29 02:56:59 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:56:59 devstack cinder-volume[82201]: DEBUG cinder.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Notifying Schedulers of capabilities ... {{(pid=82201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:56:59 devstack cinder-volume[82201]: DEBUG oslo_service.periodic_task [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running periodic task VolumeManager._thread_info {{(pid=82201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:56:59 devstack cinder-volume[82201]: DEBUG cinder.volume.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] thread count: 6 {{(pid=82201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 02:56:59 devstack cinder-volume[82201]: DEBUG cinder.volume.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] thread info: [<_MainThread(MainThread, started 138776721358976)>, , , , , ] {{(pid=82201) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 02:57:56 devstack cinder-volume[82201]: DEBUG oslo_service.periodic_task [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82201) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:57:56 devstack cinder-volume[82201]: DEBUG cinder.volume.drivers.lvm [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Updating volume stats {{(pid=82201) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 29 02:57:56 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:57:56 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 29 02:57:56 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:57:57 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Jun 29 02:57:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:57:57 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:57:57 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:57:57 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:57:58 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Jun 29 02:57:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:57:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:57:58 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 29 02:57:58 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:57:58 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Jun 29 02:57:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.619s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:57:58 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:57:58 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 29 02:57:58 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:57:59 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Jun 29 02:57:59 devstack cinder-volume[82201]: DEBUG oslo_concurrency.processutils [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82201) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:57:59 devstack cinder-volume[82201]: DEBUG cinder.manager [None req-5baec9a7-78c0-40c3-9316-76c2b566341e None None] Notifying Schedulers of capabilities ... {{(pid=82201) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:58:08 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:SELECT=1 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:58:08 devstack cinder-volume[82201]: DEBUG dbcounter [-] [82201] Writing DB stats cinder:UPDATE=1 {{(pid=82201) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:58:34 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Caught SIGTERM, stopping children Jun 29 02:58:34 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Acquiring lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:58:34 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Acquired lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:58:34 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Releasing lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:58:34 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Stop services. {{(pid=82031) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 29 02:58:34 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Killing children. {{(pid=82031) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 29 02:58:34 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Waiting on 1 children to exit Jun 29 02:58:36 devstack cinder-volume[82201]: DEBUG oslo_concurrency.lockutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Acquiring lock "singleton_lock" {{(pid=82201) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:58:36 devstack cinder-volume[82201]: DEBUG oslo_concurrency.lockutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Acquired lock "singleton_lock" {{(pid=82201) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:58:36 devstack cinder-volume[82201]: DEBUG oslo_concurrency.lockutils [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Releasing lock "singleton_lock" {{(pid=82201) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:58:36 devstack cinder-volume[82201]: WARNING amqp [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 02:58:36 devstack cinder-volume[82201]: WARNING amqp [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 02:58:36 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fcb3b323-a911-4ed4-9b4b-43e8979de9e9 None None] Child 82201 exited with status 0 Jun 29 02:58:36 devstack cinder-volume[92712]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 02:58:36 devstack cinder-volume[92712]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 02:58:36 devstack cinder-volume[92712]: we strongly recommend against using it for new projects. Jun 29 02:58:36 devstack cinder-volume[92712]: If you are already using Eventlet, we recommend migrating to a different Jun 29 02:58:36 devstack cinder-volume[92712]: framework. For more detail see Jun 29 02:58:36 devstack cinder-volume[92712]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 02:58:36 devstack cinder-volume[92712]: import eventlet # noqa Jun 29 02:58:38 devstack cinder-volume[92712]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:58:38 devstack cinder-volume[92712]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:58:38 devstack cinder-volume[92712]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:58:39 devstack cinder-volume[92712]: INFO dbcounter [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Registered counter for database cinder Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_db.sqlalchemy.engines [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92712) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG dbcounter [-] [92712] Writer thread running {{(pid=92712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 02:58:39 devstack cinder-volume[92712]: INFO cinder.rpc [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 02:58:39 devstack cinder-volume[92712]: INFO cinder.rpc [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_db.sqlalchemy.engines [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92712) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:58:39 devstack cinder-volume[92712]: INFO cinder.volume.manager [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Determined volume DB was empty at startup. Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG cinder.volume.manager [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92712) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 02:58:39 devstack cinder-volume[92712]: INFO cinder.volume.manager [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 29 02:58:39 devstack cinder-volume[92712]: WARNING stevedore.named [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 02:58:39 devstack cinder-volume[92712]: WARNING castellan.key_manager [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:58:39 devstack cinder-volume[92712]: WARNING cinder.keymgr.conf_key_mgr [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:58:39 devstack cinder-volume[92712]: INFO cinder.volume.manager [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_db.sqlalchemy.engines [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92712) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:58:39 devstack cinder-volume[92712]: INFO oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Starting 1 workers Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Started child 92927 {{(pid=92712) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Full set of CONF: {{(pid=92712) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] ******************************************************************************** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Configuration options gathered from: {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] ================================================================================ {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] allow_availability_zone_fallback = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] allow_compression_on_image_upload = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] allowed_direct_url_schemes = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] api_rate_limit = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] auth_strategy = keystone {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_availability_zone = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_host = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_stats_polling_interval = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backup_api_class = cinder.backup.api.API {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92927]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backup_name_template = backup-%s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backup_use_same_host = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backup_use_temp_snapshot = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] chap_password = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] chap_username = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_internal_tenant_project_id = 8c0df30d997d43f3a9c3a2f840c28605 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_internal_tenant_user_id = 1dc03a8a5a014a368e5dcae19c42ec1f {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cluster = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] compression_format = gzip {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] compute_api_class = cinder.compute.nova.API {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:39 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] config_dir = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] config_source = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] control_exchange = openstack {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] debug = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] default_availability_zone = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] default_group_type = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] default_volume_type = QuobyteHD {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] disk_geometry = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] driver_client_cert = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] driver_client_cert_key = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] driver_data_namespace = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] driver_ssl_cert_path = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] driver_ssl_cert_verify = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] driver_use_ssl = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] enable_new_services = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] enable_unsupported_driver = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] enabled_backends = ['QuobyteHD'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] enforce_multipath_for_image_xfer = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] filter_function = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_api_insecure = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_api_ssl_compression = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_ca_certificates_file = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_catalog_info = image:glance:publicURL {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_num_retries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance_request_timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] goodness_function = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] graceful_shutdown_timeout = 5 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] group_api_class = cinder.group.api.API {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] host = devstack {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_compress_on_upload = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_conversion_address_space_limit = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_conversion_cpu_limit = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_conversion_disable = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_upload_use_cinder_backend = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_upload_use_internal_tenant = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_volume_cache_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_volume_cache_max_count = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] image_volume_cache_max_size_gb = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] init_host_max_objects_retrieval = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] instance_format = [instance: %(uuid)s] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] iscsi_target_flags = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] iscsi_write_cache = on {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] iser_helper = tgtadm {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] iser_ip_address = 192.168.122.153 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] iser_port = 3260 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_color = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_config_append = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_dir = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_file = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_options = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_rotate_interval = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_rotate_interval_type = days {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] log_rotation_type = none {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] max_age = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] max_logfile_count = 30 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] max_logfile_size_mb = 200 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] max_over_subscription_ratio = 20.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] message_reap_interval = 86400 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] message_ttl = 2592000 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] migration_create_volume_timeout_secs = 300 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] monkey_patch = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] monkey_patch_modules = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] my_ip = 192.168.122.153 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] no_snapshot_gb_quota = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] num_iser_scan_tries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] num_shell_tries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] num_volume_device_scan_tries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] nvmeof_conn_info_version = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] nvmet_ns_id = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] nvmet_port_id = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_max_limit = 1000 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_volume_ext_list = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_volume_listen_port = 8776 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_volume_use_ssl = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] osapi_volume_workers = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] per_volume_size_limit = -1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] periodic_fuzzy_delay = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] periodic_interval = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] public_endpoint = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] publish_errors = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_backup_gigabytes = 1000 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_backups = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_gigabytes = 1000 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_groups = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_snapshots = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] quota_volumes = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] rate_limit_burst = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] rate_limit_except_level = CRITICAL {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] rate_limit_interval = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] reinit_driver_count = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] replication_device = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] report_discard_supported = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] report_interval = 120 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] reservation_clean_interval = 86400 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] reservation_expire = 86400 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] reserved_image_namespaces = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] reserved_percentage = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] rpc_response_timeout = 120 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] run_external_periodic_tasks = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] scst_target_driver = iscsi {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] scst_target_iqn_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_down_time = 720 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] shell_completion = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] snapshot_name_template = snapshot-%s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] split_loggers = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] state_path = /opt/stack/data/cinder {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] storage_availability_zone = nova {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] storage_protocol = iSCSI {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] syslog_log_facility = LOG_USER {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] target_helper = lioadm {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] target_ip_address = 192.168.122.153 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] target_port = 3260 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] target_protocol = iscsi {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] target_secondary_ip_addresses = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] trace_flags = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] transport_url = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] until_refresh = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_chap_auth = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_default_quota_class = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_journal = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_json = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_multipath_for_image_xfer = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_stderr = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] use_syslog = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] verify_glance_signatures = enabled {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92927]: INFO cinder.volume.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Starting volume driver QuobyteDriver (1.1.14) Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_api_class = cinder.volume.api.API {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.remotefs [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92927) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_backend_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_clear = zero {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_clear_ionice = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_clear_size = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_copy_bps_limit = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_dd_blocksize = 1M {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_name_template = volume-%s {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_service_inithost_offload = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volume_usage_audit_period = month {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] zoning_mode = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_concurrency.disable_process_locking = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.auth_section = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.auth_type = password {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.auth_version = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.cache = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.include_service_catalog = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.insecure = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.interface = public {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_password = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcache_username = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.region_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.service_type = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.backend = dogpile.cache.null {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.backend_argument = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.backend_expiration_time = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.config_prefix = cache.oslo {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.debug_cache_backend = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.enable_retry_client = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.enable_socket_keepalive = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.expiration_time = 600 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.hashclient_retry_attempts = 2 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_dead_retry = 300 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_pool_maxsize = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_sasl_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.password = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.proxies = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.redis_db = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.redis_server = localhost:6379 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.retry_attempts = 2 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.retry_delay = 0.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.socket_keepalive_count = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.socket_keepalive_idle = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.socket_keepalive_interval = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.socket_timeout = 1.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.tls_allowed_ciphers = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.tls_cafile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.tls_certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.tls_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.tls_keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cache.username = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] coordination.backend_url = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.asyncio_connection = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.asyncio_slave_connection = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.backend = sqlalchemy {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.connection = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.connection_debug = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.connection_parameters = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.connection_recycle_time = 3600 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.connection_trace = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.db_inc_retry_interval = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.db_max_retries = 20 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.db_max_retry_interval = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.db_retry_interval = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.max_overflow = 50 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.max_pool_size = 5 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.max_retries = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.mysql_wsrep_sync_wait = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.pool_timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.retry_interval = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.slave_connection = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.sqlite_synchronous = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.synchronous_reader = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] database.use_db_reconnect = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.connection_string = messaging:// {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.es_doc_type = notification {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.es_scroll_size = 10000 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.es_scroll_time = 2m {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.filter_error_trace = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.hmac_keys = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.sentinel_service_name = mymaster {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.socket_timeout = 0.1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.trace_requests = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler.trace_sqlalchemy = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler_jaeger.process_tags = {} {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler_jaeger.service_name_prefix = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] profiler_otlp.service_name_prefix = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.enforce_new_defaults = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: WARNING oslo_config.cfg [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.enforce_scope = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.policy_default_rule = default {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.policy_file = policy.yaml {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.group = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.helper_command = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] privsep_osbrick.user = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.group = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.helper_command = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] cinder_sys_admin.user = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.auth_section = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.auth_type = password {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.cafile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.collect_timing = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.insecure = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.send_service_user_token = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.split_loggers = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] service_user.timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.auth_section = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.auth_type = password {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.collect_timing = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.insecure = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.region_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.split_loggers = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] glance.timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.backend_availability_zone = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.chap_password = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.chap_username = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.disk_geometry = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.driver_client_cert = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.driver_client_cert_key = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.driver_data_namespace = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.driver_use_ssl = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.extra_capabilities = {} {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.filter_function = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.goodness_function = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.iscsi_target_flags = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.iscsi_write_cache = on {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.iser_helper = tgtadm {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.iser_port = 3260 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_host = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_login = admin {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_mount_options = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_password = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_private_key = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_share_path = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.num_shell_tries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.quobyte_volume_url = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.replication_device = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.report_discard_supported = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.reserved_percentage = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.target_helper = tgtadm {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.target_port = 3260 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.target_protocol = iscsi {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.trace_flags = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.unique_fqdn_network = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.use_chap_auth = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_backend_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_clear = zero {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_clear_ionice = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_clear_size = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_reports.file_event_handler = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_reports.log_dir = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.backend_availability_zone = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.backend_host = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.chap_password = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.chap_username = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.chiscsi_conf = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.disk_geometry = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.driver_client_cert = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.driver_data_namespace = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.driver_use_ssl = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.extra_capabilities = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.filter_function = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.goodness_function = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.iser_helper = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.iser_ip_address = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.iser_port = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.iser_target_prefix = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_host = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_login = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_mount_options = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_password = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_private_key = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_share_path = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_ssh_port = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.num_shell_tries = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.nvmet_port_id = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92927) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 29 02:58:40 devstack cinder-volume[92927]: WARNING cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.replication_device = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92927]: WARNING cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.report_discard_supported = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.reserved_percentage = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.scst_target_driver = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.storage_protocol = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.target_helper = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.target_ip_address = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.target_port = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.target_prefix = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Running cmd (subprocess): mount.quobyte {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.target_protocol = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.trace_flags = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.use_chap_auth = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_clear = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_clear_size = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] QuobyteHD.volumes_dir = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_notifications.driver = [] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_notifications.retry = -1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] key_manager.fixed_key = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.barbican_api_version = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.barbican_endpoint = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.barbican_endpoint_type = public {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.barbican_region_name = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.cafile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.collect_timing = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.insecure = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.number_of_retries = 60 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.retry_delay = 1 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.send_service_user_token = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.split_loggers = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.verify_ssl = True {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican.verify_ssl_path = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.auth_section = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.auth_type = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.cafile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.certfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.collect_timing = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.insecure = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.keyfile = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.split_loggers = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] barbican_service_user.timeout = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.approle_role_id = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.approle_secret_id = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.kv_mountpoint = secret {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.kv_path = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.kv_version = 2 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.namespace = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.root_token_id = **** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.ssl_ca_crt_file = None {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.timeout = 60.0 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.use_ssl = False {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:58:40 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] ******************************************************************************** {{(pid=92712) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 02:58:40 devstack quobyte-client[92930]: Reading configuration file: /etc/quobyte/client.cfg Jun 29 02:58:40 devstack quobyte-client[92930]: Invalid parameters found, error: missing mount point. Jun 29 02:58:40 devstack quobyte-client[92930]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 29 02:58:40 devstack quobyte-client[92930]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=92927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:58:40 devstack cinder-volume[92927]: INFO cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c ... Jun 29 02:58:40 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 -c /etc/quobyte/client-cinder.cfg {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:58:40 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 -c /etc/quobyte/client-cinder.cfg Jun 29 02:58:40 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:58:41 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.740s {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:58:41 devstack cinder-volume[92927]: INFO cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c succeeded Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=92927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.753s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:58:41 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:58:41 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:58:41 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.609s {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:58:41 devstack cinder-volume[92927]: INFO cinder.volume.driver [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Driver hasn't implemented _init_vendor_properties() Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG cinder.volume.driver [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92927) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_db.sqlalchemy.engines [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92927) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG dbcounter [-] [92927] Writer thread running {{(pid=92927) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG cinder.db.api [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Building query based on filter {{(pid=92927) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG cinder.image.image_utils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92927) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 02:58:41 devstack cinder-volume[92927]: INFO cinder.keymgr.migration [None req-1a0ca0ee-f4cc-43ce-b544-c949fde98fa6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=92927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=92927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:58:41 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:58:41 devstack sudo[93006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:58:41 devstack sudo[93006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:58:42 devstack sudo[93006]: pam_unix(sudo:session): session closed for user root Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.593s {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG cinder.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Notifying Schedulers of capabilities ... {{(pid=92927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:58:42 devstack cinder-volume[92927]: INFO cinder.volume.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Driver initialization completed successfully. Jun 29 02:58:42 devstack cinder-volume[92927]: INFO cinder.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Initiating service 3 cleanup Jun 29 02:58:42 devstack cinder-volume[92927]: INFO cinder.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Service 3 cleanup completed. Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG cinder.service [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Creating RPC server for service cinder-volume {{(pid=92927) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG cinder.service [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92927) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 02:58:42 devstack cinder-volume[92927]: INFO cinder.volume.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=92927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=92927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:58:42 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:58:42 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:58:42 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:58:43 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Jun 29 02:58:43 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.643s {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:58:43 devstack cinder-volume[92927]: INFO cinder.volume.manager [None req-91e72539-a0eb-4ebe-ba4b-a7ce6d722ece None None] Driver post RPC initialization completed successfully. Jun 29 02:58:47 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:58:47 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:58:47 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=92927) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:58:47 devstack cinder-volume[92927]: DEBUG cinder.volume.drivers.quobyte [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=92927) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:58:47 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92927) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:58:47 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:58:47 devstack sudo[93129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:58:47 devstack sudo[93129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:58:48 devstack sudo[93129]: pam_unix(sudo:session): session closed for user root Jun 29 02:58:48 devstack cinder-volume[92927]: DEBUG oslo_concurrency.processutils [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.591s {{(pid=92927) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:58:48 devstack cinder-volume[92927]: DEBUG cinder.manager [None req-420f19da-fd3b-42ff-8eb8-9e3f898337ce None None] Notifying Schedulers of capabilities ... {{(pid=92927) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:58:49 devstack cinder-volume[92712]: DEBUG dbcounter [-] [92712] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92712) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:58:51 devstack cinder-volume[92712]: INFO oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Caught SIGTERM, stopping children Jun 29 02:58:51 devstack cinder-volume[92712]: DEBUG oslo_concurrency.lockutils [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Acquiring lock "singleton_lock" {{(pid=92712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:58:51 devstack cinder-volume[92712]: DEBUG oslo_concurrency.lockutils [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Acquired lock "singleton_lock" {{(pid=92712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:58:51 devstack cinder-volume[92712]: DEBUG oslo_concurrency.lockutils [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Releasing lock "singleton_lock" {{(pid=92712) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:58:51 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Stop services. {{(pid=92712) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 29 02:58:51 devstack cinder-volume[92712]: DEBUG oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Killing children. {{(pid=92712) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 29 02:58:51 devstack cinder-volume[92712]: INFO oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Waiting on 1 children to exit Jun 29 02:58:53 devstack cinder-volume[92927]: DEBUG dbcounter [-] [92927] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92927) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:58:53 devstack cinder-volume[92927]: DEBUG dbcounter [-] [92927] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=92927) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:58:55 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Acquiring lock "singleton_lock" {{(pid=92927) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:58:55 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Acquired lock "singleton_lock" {{(pid=92927) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:58:55 devstack cinder-volume[92927]: DEBUG oslo_concurrency.lockutils [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Releasing lock "singleton_lock" {{(pid=92927) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:58:55 devstack cinder-volume[92927]: WARNING amqp [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 02:58:55 devstack cinder-volume[92927]: WARNING amqp [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 29 02:58:55 devstack cinder-volume[92712]: INFO oslo_service.backend._eventlet.service [None req-50f58dae-9e88-4da8-a304-a670f6aa2455 None None] Child 92927 exited with status 0 Jun 29 02:58:56 devstack cinder-volume[93220]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 29 02:58:56 devstack cinder-volume[93220]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 02:58:56 devstack cinder-volume[93220]: we strongly recommend against using it for new projects. Jun 29 02:58:56 devstack cinder-volume[93220]: If you are already using Eventlet, we recommend migrating to a different Jun 29 02:58:56 devstack cinder-volume[93220]: framework. For more detail see Jun 29 02:58:56 devstack cinder-volume[93220]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 02:58:56 devstack cinder-volume[93220]: import eventlet # noqa Jun 29 02:58:58 devstack cinder-volume[93220]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93220) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 29 02:58:58 devstack cinder-volume[93220]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93220) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 29 02:58:58 devstack cinder-volume[93220]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93220) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 29 02:58:59 devstack cinder-volume[93220]: INFO dbcounter [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Registered counter for database cinder Jun 29 02:58:59 devstack cinder-volume[93220]: DEBUG oslo_db.sqlalchemy.engines [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:58:59 devstack cinder-volume[93220]: DEBUG dbcounter [-] [93220] Writer thread running {{(pid=93220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 02:58:59 devstack cinder-volume[93220]: INFO cinder.rpc [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 29 02:58:59 devstack cinder-volume[93220]: INFO cinder.rpc [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 29 02:58:59 devstack cinder-volume[93220]: DEBUG oslo_db.sqlalchemy.engines [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:59:00 devstack cinder-volume[93220]: INFO cinder.volume.manager [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Determined volume DB was empty at startup. Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG cinder.volume.manager [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93220) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 29 02:59:00 devstack cinder-volume[93220]: WARNING stevedore.named [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 29 02:59:00 devstack cinder-volume[93220]: WARNING castellan.key_manager [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:59:00 devstack cinder-volume[93220]: WARNING cinder.keymgr.conf_key_mgr [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 29 02:59:00 devstack cinder-volume[93220]: INFO cinder.volume.manager [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_db.sqlalchemy.engines [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:59:00 devstack cinder-volume[93220]: INFO oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Starting 1 workers Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Started child 93518 {{(pid=93220) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Full set of CONF: {{(pid=93220) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] ******************************************************************************** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Configuration options gathered from: {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] ================================================================================ {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] allow_availability_zone_fallback = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] allow_compression_on_image_upload = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] allowed_direct_url_schemes = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] api_rate_limit = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] auth_strategy = keystone {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_availability_zone = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93518]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_host = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_stats_polling_interval = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backup_api_class = cinder.backup.api.API {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backup_name_template = backup-%s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backup_use_same_host = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backup_use_temp_snapshot = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] chap_password = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] chap_username = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_internal_tenant_project_id = 8c0df30d997d43f3a9c3a2f840c28605 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_internal_tenant_user_id = 1dc03a8a5a014a368e5dcae19c42ec1f {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cluster = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] compression_format = gzip {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] compute_api_class = cinder.compute.nova.API {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] config_dir = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] config_source = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] control_exchange = openstack {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] debug = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] default_availability_zone = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] default_group_type = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] default_volume_type = QuobyteHD {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] disk_geometry = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] driver_client_cert = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] driver_client_cert_key = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] driver_data_namespace = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] driver_ssl_cert_path = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] driver_ssl_cert_verify = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] driver_use_ssl = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] enable_new_services = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] enable_unsupported_driver = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] enabled_backends = ['QuobyteHD'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] enforce_multipath_for_image_xfer = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] filter_function = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_api_insecure = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_api_servers = ['http://192.168.122.153/image'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_api_ssl_compression = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_ca_certificates_file = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93518) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_catalog_info = image:glance:publicURL {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_num_retries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance_request_timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] goodness_function = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] graceful_shutdown_timeout = 5 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] group_api_class = cinder.group.api.API {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] host = devstack {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_compress_on_upload = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_conversion_address_space_limit = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_conversion_cpu_limit = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_conversion_disable = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_upload_use_cinder_backend = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_upload_use_internal_tenant = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_volume_cache_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_volume_cache_max_count = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] image_volume_cache_max_size_gb = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] init_host_max_objects_retrieval = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] instance_format = [instance: %(uuid)s] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] iscsi_target_flags = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] iscsi_write_cache = on {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] iser_helper = tgtadm {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] iser_ip_address = 192.168.122.153 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] iser_port = 3260 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_color = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_config_append = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_dir = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_file = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_options = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_rotate_interval = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_rotate_interval_type = days {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] log_rotation_type = none {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] max_age = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] max_logfile_count = 30 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] max_logfile_size_mb = 200 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] max_over_subscription_ratio = 20.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] message_reap_interval = 86400 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] message_ttl = 2592000 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] migration_create_volume_timeout_secs = 300 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] monkey_patch = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] monkey_patch_modules = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] my_ip = 192.168.122.153 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] no_snapshot_gb_quota = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] num_iser_scan_tries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] num_shell_tries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] num_volume_device_scan_tries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] nvmeof_conn_info_version = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] nvmet_ns_id = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] nvmet_port_id = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_max_limit = 1000 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_volume_ext_list = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_volume_listen = 0.0.0.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_volume_listen_port = 8776 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_volume_use_ssl = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] osapi_volume_workers = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] per_volume_size_limit = -1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] periodic_fuzzy_delay = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] periodic_interval = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] project_id_regex = [0-9a-f\-]+ {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] public_endpoint = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] publish_errors = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_backup_gigabytes = 1000 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_backups = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_gigabytes = 1000 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_groups = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_snapshots = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] quota_volumes = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] rate_limit_burst = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] rate_limit_except_level = CRITICAL {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] rate_limit_interval = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] reinit_driver_count = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] replication_device = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] report_discard_supported = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] report_interval = 120 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] reservation_clean_interval = 86400 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] reservation_expire = 86400 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] reserved_image_namespaces = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] reserved_percentage = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] rpc_response_timeout = 120 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] run_external_periodic_tasks = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] scst_target_driver = iscsi {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] scst_target_iqn_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_down_time = 720 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] shell_completion = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] snapshot_name_template = snapshot-%s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] split_loggers = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] state_path = /opt/stack/data/cinder {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] storage_availability_zone = nova {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] storage_protocol = iSCSI {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] syslog_log_facility = LOG_USER {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] target_helper = lioadm {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] target_ip_address = 192.168.122.153 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] target_port = 3260 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] target_protocol = iscsi {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] target_secondary_ip_addresses = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] trace_flags = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] transfer_api_class = cinder.transfer.api.API {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] transport_url = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] until_refresh = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_chap_auth = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_default_quota_class = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_journal = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_json = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_multipath_for_image_xfer = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_stderr = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] use_syslog = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] verify_glance_signatures = enabled {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_api_class = cinder.volume.api.API {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_backend_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_clear = zero {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_clear_ionice = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_clear_size = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_copy_bps_limit = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_dd_blocksize = 1M {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_name_template = volume-%s {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_service_inithost_offload = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volume_usage_audit_period = month {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] zoning_mode = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93518) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 29 02:59:00 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 29 02:59:00 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_concurrency.disable_process_locking = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Running cmd (subprocess): mount.quobyte {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.auth_section = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.auth_type = password {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.auth_version = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.cache = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.delay_auth_decision = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.http_connect_timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.include_service_catalog = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.insecure = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.interface = public {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_password = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcache_username = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.region_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.service_token_roles_required = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.service_type = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.token_cache_time = 300 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.153/identity {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.backend = dogpile.cache.null {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.backend_argument = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.backend_expiration_time = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.config_prefix = cache.oslo {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.debug_cache_backend = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.enable_retry_client = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.enable_socket_keepalive = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.expiration_time = 600 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.hashclient_retry_attempts = 2 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_dead_retry = 300 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_pool_maxsize = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_sasl_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.password = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.proxies = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.redis_db = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.redis_sentinel_service_name = mymaster {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.redis_server = localhost:6379 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.retry_attempts = 2 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.retry_delay = 0.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.socket_keepalive_count = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.socket_keepalive_idle = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.socket_keepalive_interval = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.socket_timeout = 1.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.tls_allowed_ciphers = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.tls_cafile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.tls_certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.tls_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.tls_keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cache.username = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] coordination.backend_url = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.asyncio_connection = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.asyncio_slave_connection = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.backend = sqlalchemy {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.connection = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.connection_debug = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.connection_parameters = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.connection_recycle_time = 3600 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.connection_trace = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.db_inc_retry_interval = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.db_max_retries = 20 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.db_max_retry_interval = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.db_retry_interval = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.max_overflow = 50 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.max_pool_size = 5 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.max_retries = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.mysql_wsrep_sync_wait = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.pool_timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.retry_interval = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.slave_connection = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.sqlite_synchronous = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.synchronous_reader = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] database.use_db_reconnect = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.connection_string = messaging:// {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.es_doc_type = notification {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.es_scroll_size = 10000 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.es_scroll_time = 2m {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.filter_error_trace = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.hmac_keys = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.sentinel_service_name = mymaster {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.socket_timeout = 0.1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.trace_requests = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler.trace_sqlalchemy = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler_jaeger.process_tags = {} {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler_jaeger.service_name_prefix = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] profiler_otlp.service_name_prefix = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.enforce_new_defaults = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: WARNING oslo_config.cfg [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.enforce_scope = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.policy_default_rule = default {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.policy_file = policy.yaml {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_policy.remote_timeout = 60.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.group = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.helper_command = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] privsep_osbrick.user = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.group = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.helper_command = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] cinder_sys_admin.user = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.auth_section = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.auth_type = password {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.cafile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.collect_timing = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.insecure = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.send_service_user_token = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.split_loggers = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] service_user.timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.auth_section = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.auth_type = password {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.collect_timing = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.insecure = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.region_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.split_loggers = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] glance.timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.backend_availability_zone = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.chap_password = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.chap_username = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.disk_geometry = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.driver_client_cert = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.driver_client_cert_key = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.driver_data_namespace = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.driver_use_ssl = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.enable_unsupported_driver = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.extra_capabilities = {} {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.filter_function = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.goodness_function = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.iscsi_target_flags = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.iscsi_write_cache = on {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.iser_helper = tgtadm {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.iser_ip_address = 192.168.122.153 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.iser_port = 3260 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_host = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_login = admin {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_mount_options = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_password = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_private_key = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_share_path = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_ssh_port = 22 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.num_shell_tries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.nvmet_port_id = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_client_cfg = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack quobyte-client[93519]: Reading configuration file: /etc/quobyte/client.cfg Jun 29 02:59:00 devstack quobyte-client[93519]: Invalid parameters found, error: missing mount point. Jun 29 02:59:00 devstack quobyte-client[93519]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.quobyte_volume_url = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.replication_device = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack quobyte-client[93519]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.report_discard_supported = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.reserved_percentage = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.scst_target_driver = iscsi {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.scst_target_iqn_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.storage_protocol = iSCSI {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] CMD "mount.quobyte" returned: 1 in 0.086s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.target_helper = tgtadm {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.target_ip_address = 192.168.122.153 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.target_port = 3260 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.target_protocol = iscsi {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.trace_flags = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.unique_fqdn_network = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.use_chap_auth = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_backend_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_clear = zero {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_clear_ionice = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_clear_size = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_reports.file_event_handler = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_reports.log_dir = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.backend_availability_zone = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.backend_host = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.chap_password = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.chap_username = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.chiscsi_conf = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.disk_geometry = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.driver_client_cert = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.driver_client_cert_key = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.driver_data_namespace = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.driver_use_ssl = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.extra_capabilities = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.filter_function = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.goodness_function = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.iscsi_target_flags = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.iscsi_write_cache = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.iser_helper = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.iser_ip_address = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.iser_port = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.iser_target_prefix = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_host = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_login = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_mount_options = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_password = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_private_key = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_share_path = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_ssh_port = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.num_shell_tries = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nvmet_ns_id = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.nvmet_port_id = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.replication_device = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.report_discard_supported = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.reserved_percentage = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.scst_target_driver = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.storage_protocol = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.target_helper = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.target_ip_address = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.target_port = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.target_prefix = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.target_protocol = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.trace_flags = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.unique_fqdn_network = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.use_chap_auth = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_clear = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_clear_ionice = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_clear_size = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] QuobyteHD.volumes_dir = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:59:00 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.ssl_version = {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_notifications.driver = [] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_notifications.retry = -1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] oslo_messaging_notifications.transport_url = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] key_manager.fixed_key = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.barbican_api_version = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.barbican_endpoint = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.barbican_endpoint_type = public {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.barbican_region_name = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.cafile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.collect_timing = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.insecure = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.number_of_retries = 60 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.retry_delay = 1 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.send_service_user_token = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.split_loggers = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.verify_ssl = True {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican.verify_ssl_path = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.auth_section = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.auth_type = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.cafile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.certfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.collect_timing = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.insecure = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.keyfile = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.split_loggers = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] barbican_service_user.timeout = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.approle_role_id = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.approle_secret_id = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.kv_mountpoint = secret {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.kv_path = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.kv_version = 2 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.namespace = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.root_token_id = **** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.ssl_ca_crt_file = None {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.timeout = 60.0 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.use_ssl = False {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 29 02:59:00 devstack cinder-volume[93220]: DEBUG oslo_service.backend._eventlet.service [None req-4db2fddc-138e-4c2b-af71-b2c30a18719e None None] ******************************************************************************** {{(pid=93220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 29 02:59:01 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.646s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:59:01 devstack cinder-volume[93518]: INFO cinder.volume.driver [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Driver hasn't implemented _init_vendor_properties() Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.volume.driver [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93518) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_db.sqlalchemy.engines [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93518) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writer thread running {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.db.api [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Building query based on filter {{(pid=93518) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93518) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:59:01 devstack cinder-volume[93518]: INFO cinder.keymgr.migration [None req-8ea86381-54aa-448b-ace8-7ef448ea8092 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 29 02:59:01 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:59:01 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:59:01 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.625s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 02:59:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Driver initialization completed successfully. Jun 29 02:59:01 devstack cinder-volume[93518]: INFO cinder.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Initiating service 3 cleanup Jun 29 02:59:01 devstack cinder-volume[93518]: INFO cinder.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Service 3 cleanup completed. Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.service [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Creating RPC server for service cinder-volume {{(pid=93518) start /opt/stack/cinder/cinder/service.py:231}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.service [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93518) start /opt/stack/cinder/cinder/service.py:237}} Jun 29 02:59:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 02:59:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 02:59:01 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 02:59:01 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 02:59:02 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Jun 29 02:59:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.623s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 02:59:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cdaa03f6-ace1-4d33-a5a4-c0487d6f6f84 None None] Driver post RPC initialization completed successfully. Jun 29 02:59:10 devstack cinder-volume[93220]: DEBUG dbcounter [-] [93220] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:59:11 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:59:12 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 02:59:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 02:59:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 6 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 02:59:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:17 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:00:17 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:19 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 2.261s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:19 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:00:19 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:00:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 6 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:00:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Flow 'volume_create_manager' (3f92ecb9-79c7-463c-b42c-a002e89d31bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378a31d4-9d3c-43df-98c5-31fae976689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378a31d4-9d3c-43df-98c5-31fae976689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-273563782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eda8de6-fd86-401b-ae38-f3ab6c9968b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e3034b571b48538ce2e399ac4ae184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:30Z,use_quota=True,user_id='686466298d2343baae96b84ae7ada0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aded6170-26b4-45c3-8410-0acce3823b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aded6170-26b4-45c3-8410-0acce3823b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233181fa-57be-465f-9621-15c2839f22cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233181fa-57be-465f-9621-15c2839f22cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eda8de6-fd86-401b-ae38-f3ab6c9968b0', 'volume_name': 'volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6db15b8-ebb6-4a5a-9942-7a13185d09bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6db15b8-ebb6-4a5a-9942-7a13185d09bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4b6d1-0e10-4d75-87c5-16ae0b6292bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:30 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Volume 2eda8de6-fd86-401b-ae38-f3ab6c9968b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0', 'volume_size': 1} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-273563782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eda8de6-fd86-401b-ae38-f3ab6c9968b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8e3034b571b48538ce2e399ac4ae184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:30Z,use_quota=True,user_id='686466298d2343baae96b84ae7ada0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Creating volume 2eda8de6-fd86-401b-ae38-f3ab6c9968b0 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:00:30 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:00:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:30 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 1073741824 Jun 29 03:00:30 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:32 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 1073741824" returned: 0 in 1.892s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:32 devstack sudo[94779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 Jun 29 03:00:32 devstack sudo[94779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:33 devstack sudo[94779]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0" returned: 0 in 0.735s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] <== create_volume: return (2709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.717s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc4b6d1-0e10-4d75-87c5-16ae0b6292bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f7e27b-012f-4dcb-8db0-6a2b8aef77c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:33 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Volume volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 (2eda8de6-fd86-401b-ae38-f3ab6c9968b0): created successfully Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f7e27b-012f-4dcb-8db0-6a2b8aef77c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Flow 'volume_create_manager' (3f92ecb9-79c7-463c-b42c-a002e89d31bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d8915cc4-1a1b-4603-a1ec-9f791a83ff7e tempest-VolumesAdminNegativeTest-1250313769 None] Created volume successfully. Jun 29 03:00:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Acquiring lock "cinder-2eda8de6-fd86-401b-ae38-f3ab6c9968b0-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:00:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Lock "cinder-2eda8de6-fd86-401b-ae38-f3ab6c9968b0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:00:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Acquiring lock "cinder-quobyte-2eda8de6-fd86-401b-ae38-f3ab6c9968b0" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:00:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Lock "cinder-quobyte-2eda8de6-fd86-401b-ae38-f3ab6c9968b0" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:00:34 devstack cinder-volume[93518]: INFO oslo.privsep.daemon [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpr6php_da/privsep.sock'] Jun 29 03:00:34 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpr6php_da/privsep.sock Jun 29 03:00:34 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:00:35 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: Jun 29 03:00:37 devstack cinder-volume[93518]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 29 03:00:38 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:38 devstack cinder-volume[93518]: INFO oslo.privsep.daemon [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Spawned new privsep daemon via rootwrap Jun 29 03:00:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Accepted privsep connection to /tmp/tmpr6php_da/privsep.sock {{(pid=93518) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 29 03:00:38 devstack cinder-volume[93518]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 29 03:00:38 devstack cinder-volume[93518]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 29 03:00:38 devstack cinder-volume[93518]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 29 03:00:38 devstack cinder-volume[93518]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94847 Jun 29 03:00:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06d94d2-5405-4596-b131-47759d7eacb2]: (2,) {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:00:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0671c3-f495-4ec9-a67a-454f973e899f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:00:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:38 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 Jun 29 03:00:38 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:40 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0" returned: 0 in 1.551s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:40 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0 Jun 29 03:00:40 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:41 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2eda8de6-fd86-401b-ae38-f3ab6c9968b0" returned: 0 in 1.231s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Lock "cinder-quobyte-2eda8de6-fd86-401b-ae38-f3ab6c9968b0" released by "delete_volume" :: held 6.552s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:00:41 devstack cinder-volume[93518]: WARNING cinder.quota [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:00:41 devstack cinder-volume[93518]: WARNING cinder.quota [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Created reservations ['d19ab24e-aff6-48c6-9abc-574861c04e73', '3ba4a4fe-e5f2-461b-a635-395ea38a7f4d', 'ff2889fd-78c9-4fba-88a8-f3abb0e4bc1f', '9ae60a34-7ab4-4abd-b3ea-b332baa86a6f'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:41 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:00:41 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:42 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.774s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:42 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:00:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Deleted volume successfully. Jun 29 03:00:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-acaffe6c-8206-4636-8bfc-1c6ef92789a7 tempest-VolumesAdminNegativeTest-1250313769 None] Lock "cinder-2eda8de6-fd86-401b-ae38-f3ab6c9968b0-delete_volume" released by "delete_volume" :: held 7.731s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Flow 'volume_create_manager' (ad06e9c4-f80a-4d82-bb30-3f2e3d3ea178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d833d7f-9360-4a8c-bdd7-27cc59a3b6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d833d7f-9360-4a8c-bdd7-27cc59a3b6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1560750483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b8732b-3b7f-474d-8e06-b85103db91b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1936a5953384069ac064d1fa904b49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:45Z,use_quota=True,user_id='8a0f54da24f146f98fa2fcaf5b694ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e97884-459e-4715-8a8a-330456687c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e97884-459e-4715-8a8a-330456687c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcc9464-910e-4e95-8b87-153fa39b1989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcc9464-910e-4e95-8b87-153fa39b1989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b8732b-3b7f-474d-8e06-b85103db91b3', 'volume_name': 'volume-05b8732b-3b7f-474d-8e06-b85103db91b3', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c8d817-4575-459f-89e6-d53028639e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c8d817-4575-459f-89e6-d53028639e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e48ab-f0c0-4ce3-82c7-93b471027112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:45 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Volume 05b8732b-3b7f-474d-8e06-b85103db91b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b8732b-3b7f-474d-8e06-b85103db91b3', 'volume_size': 1} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1560750483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05b8732b-3b7f-474d-8e06-b85103db91b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1936a5953384069ac064d1fa904b49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:45Z,use_quota=True,user_id='8a0f54da24f146f98fa2fcaf5b694ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Creating volume 05b8732b-3b7f-474d-8e06-b85103db91b3 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:00:45 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:00:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:45 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 1073741824 Jun 29 03:00:45 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:46 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 1073741824" returned: 0 in 0.879s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:46 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 Jun 29 03:00:46 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:47 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3" returned: 0 in 0.977s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e48ab-f0c0-4ce3-82c7-93b471027112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b8732b-3b7f-474d-8e06-b85103db91b3', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a181d240-60ee-439b-ad2b-861ea6ef04d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:47 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Volume volume-05b8732b-3b7f-474d-8e06-b85103db91b3 (05b8732b-3b7f-474d-8e06-b85103db91b3): created successfully Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a181d240-60ee-439b-ad2b-861ea6ef04d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Flow 'volume_create_manager' (ad06e9c4-f80a-4d82-bb30-3f2e3d3ea178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-bd5f9aca-6a02-43a7-9529-872ba2466438 tempest-AttachVolumeNegativeTest-2146070891 None] Created volume successfully. Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Flow 'volume_create_manager' (43fcfbfa-a0f4-4009-8e09-5932b960a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eedd99-feac-488a-bacf-f57f9e8e5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eedd99-feac-488a-bacf-f57f9e8e5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1753987132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aded6bf-d7e9-44eb-916e-7df089253850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80cd87336a904961be31fbb443c05b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:48Z,use_quota=True,user_id='2223c6870e6740cf830910ed0fe102b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9559c216-e140-4b08-acd1-c01d70de6435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9559c216-e140-4b08-acd1-c01d70de6435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0489071-af08-47a0-b2a7-181b1943efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0489071-af08-47a0-b2a7-181b1943efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aded6bf-d7e9-44eb-916e-7df089253850', 'volume_name': 'volume-9aded6bf-d7e9-44eb-916e-7df089253850', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3a0609-9d24-4d00-917a-ebd8a436cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3a0609-9d24-4d00-917a-ebd8a436cdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15974970-42b3-45ae-bd81-e53e8b8cb051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:47 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Volume 9aded6bf-d7e9-44eb-916e-7df089253850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aded6bf-d7e9-44eb-916e-7df089253850', 'volume_size': 1} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1753987132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aded6bf-d7e9-44eb-916e-7df089253850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80cd87336a904961be31fbb443c05b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:48Z,use_quota=True,user_id='2223c6870e6740cf830910ed0fe102b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Creating volume 9aded6bf-d7e9-44eb-916e-7df089253850 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:00:47 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:00:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:47 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 1073741824 Jun 29 03:00:47 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:48 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 1073741824" returned: 0 in 0.957s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:48 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 Jun 29 03:00:48 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:49 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15974970-42b3-45ae-bd81-e53e8b8cb051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aded6bf-d7e9-44eb-916e-7df089253850', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f86ce31-67a0-4210-8d5f-20c1c09245cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Volume volume-9aded6bf-d7e9-44eb-916e-7df089253850 (9aded6bf-d7e9-44eb-916e-7df089253850): created successfully Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f86ce31-67a0-4210-8d5f-20c1c09245cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Flow 'volume_create_manager' (43fcfbfa-a0f4-4009-8e09-5932b960a2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6ed09f93-8a14-4262-abd0-e03683b95bbd tempest-ServersNegativeTestJSON-2011064066 None] Created volume successfully. Jun 29 03:00:54 devstack cinder-volume[93518]: WARNING py.warnings [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 29 03:00:54 devstack cinder-volume[93518]: .first() Jun 29 03:00:54 devstack cinder-volume[93518]: Jun 29 03:00:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fd811e-92d7-4e6b-b964-40bebaed55e2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:00:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:54 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 Jun 29 03:00:54 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:55 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3" returned: 0 in 1.176s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.209s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Flow 'volume_create_manager' (ceb441c4-fead-41c9-bc9b-2c90389aed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86fe738-8596-4379-9e94-25339d39bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86fe738-8596-4379-9e94-25339d39bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-689156384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800b7b42-52da-47e6-970a-d0249acc4b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80cd87336a904961be31fbb443c05b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:55Z,use_quota=True,user_id='2223c6870e6740cf830910ed0fe102b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c67411-a391-4748-9b19-27bcbf610400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c67411-a391-4748-9b19-27bcbf610400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc95447-2b53-448f-baed-e29c809d359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc95447-2b53-448f-baed-e29c809d359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800b7b42-52da-47e6-970a-d0249acc4b46', 'volume_name': 'volume-800b7b42-52da-47e6-970a-d0249acc4b46', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8a360f-f572-455f-9577-040cf014ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8a360f-f572-455f-9577-040cf014ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128ad62-9c4d-46cf-af06-542ad56a6825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:55 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Volume 800b7b42-52da-47e6-970a-d0249acc4b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800b7b42-52da-47e6-970a-d0249acc4b46', 'volume_size': 1} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:00:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-689156384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800b7b42-52da-47e6-970a-d0249acc4b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80cd87336a904961be31fbb443c05b5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:00:55Z,use_quota=True,user_id='2223c6870e6740cf830910ed0fe102b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Creating volume 800b7b42-52da-47e6-970a-d0249acc4b46 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:00:55 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:55 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 1073741824 Jun 29 03:00:55 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-05b8732b-3b7f-474d-8e06-b85103db91b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a131d9d-0efd-4189-9afa-c442868ced66', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:00:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-11e7cd08-fd8d-4da9-8b99-4518adbdddad req-d658b0d6-005f-4c66-bbdf-7696b6b080f1 tempest-AttachVolumeNegativeTest-2146070891 None] attachment_update completed successfully. Jun 29 03:00:56 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 1073741824" returned: 0 in 1.148s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:00:56 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 Jun 29 03:00:56 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:00:57 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46" returned: 0 in 0.776s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] <== create_volume: return (2023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128ad62-9c4d-46cf-af06-542ad56a6825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800b7b42-52da-47e6-970a-d0249acc4b46', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989d9668-a11f-4a5a-a091-393b8b557b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:00:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Volume volume-800b7b42-52da-47e6-970a-d0249acc4b46 (800b7b42-52da-47e6-970a-d0249acc4b46): created successfully Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989d9668-a11f-4a5a-a091-393b8b557b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:00:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Flow 'volume_create_manager' (ceb441c4-fead-41c9-bc9b-2c90389aed21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:00:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5ac5965f-8261-49fb-b088-091f3455a324 tempest-ServersNegativeTestJSON-2011064066 None] Created volume successfully. Jun 29 03:00:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "cinder-800b7b42-52da-47e6-970a-d0249acc4b46-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:00:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-800b7b42-52da-47e6-970a-d0249acc4b46-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:00:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "cinder-quobyte-800b7b42-52da-47e6-970a-d0249acc4b46" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:00:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-quobyte-800b7b42-52da-47e6-970a-d0249acc4b46" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:00:59 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ab4731-3a88-4a92-aba9-17205ff49817]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:00:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:00 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 Jun 29 03:01:00 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:01 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46" returned: 0 in 1.119s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:01 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46 Jun 29 03:01:01 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:01 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-800b7b42-52da-47e6-970a-d0249acc4b46" returned: 0 in 0.862s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-quobyte-800b7b42-52da-47e6-970a-d0249acc4b46" released by "delete_volume" :: held 2.039s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:01 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Created reservations ['6523096c-1cf4-428b-9987-2fa72a24a78f', '79098c32-d3d4-472e-80a2-d6d86260a061', '56757f25-bae7-4393-8782-246788b43231', '3cc225c7-a0d5-4cb6-9e65-d74e5db9119c'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:02 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:01:02 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "cinder-9aded6bf-d7e9-44eb-916e-7df089253850-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-9aded6bf-d7e9-44eb-916e-7df089253850-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "cinder-quobyte-9aded6bf-d7e9-44eb-916e-7df089253850" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-quobyte-9aded6bf-d7e9-44eb-916e-7df089253850" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a10c20-a67b-4aae-b567-8c6ff944f13e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:02 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 Jun 29 03:01:02 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:03 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.089s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:03 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:01:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Deleted volume successfully. Jun 29 03:01:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a34bd9e3-dde6-412b-a570-15d61bb2918d tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-800b7b42-52da-47e6-970a-d0249acc4b46-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:03 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850" returned: 0 in 1.260s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:03 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850 Jun 29 03:01:03 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:04 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9aded6bf-d7e9-44eb-916e-7df089253850" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-quobyte-9aded6bf-d7e9-44eb-916e-7df089253850" released by "delete_volume" :: held 2.158s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Created reservations ['914fa741-582d-470e-ad8a-841ad2568dd0', '95e596b9-52c9-41bd-a88a-9a37c7c9c7eb', '75452a2d-e32a-4de2-818a-fa7761261815', '2349f573-d12b-4230-bfbc-842e78500666'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:04 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:01:04 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:05 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.907s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:05 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:01:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Deleted volume successfully. Jun 29 03:01:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1fdffed7-d40b-430a-a249-971626cb5688 tempest-ServersNegativeTestJSON-2011064066 None] Lock "cinder-9aded6bf-d7e9-44eb-916e-7df089253850-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:14 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=45,cinder:SELECT=26,cinder:INSERT=9,cinder:DELETE=4 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:01:15 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:17 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:01:17 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:18 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.140s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:01:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:01:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 8 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:01:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Flow 'volume_create_manager' (421c5c00-f924-4b83-a12c-26a63fe3fdb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32f59fa-697f-44fa-8d1f-3fa253e5abc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c32f59fa-697f-44fa-8d1f-3fa253e5abc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1237863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ad5a9c-2bf0-4721-9f84-2af3394276dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6c28c8c5341e59eee359a913a3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:22Z,use_quota=True,user_id='0bbfe20a7e684a079b37f889cf408de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29050959-0071-4440-9471-1c2c576e2e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29050959-0071-4440-9471-1c2c576e2e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b40c12-40ce-4ff8-8a63-759441d8101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b40c12-40ce-4ff8-8a63-759441d8101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ad5a9c-2bf0-4721-9f84-2af3394276dc', 'volume_name': 'volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6f7aa3-f775-426a-831e-b964026386b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6f7aa3-f775-426a-831e-b964026386b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c30c65-2248-4dcf-a845-2cf591dc530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Volume f9ad5a9c-2bf0-4721-9f84-2af3394276dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc', 'volume_size': 1} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1237863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ad5a9c-2bf0-4721-9f84-2af3394276dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f6c28c8c5341e59eee359a913a3634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:22Z,use_quota=True,user_id='0bbfe20a7e684a079b37f889cf408de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Creating volume f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:01:22 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:01:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:22 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc 1073741824 Jun 29 03:01:22 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:24 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc 1073741824" returned: 0 in 1.471s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:24 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc Jun 29 03:01:24 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:25 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" returned: 0 in 1.040s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] <== create_volume: return (2586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.593s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c30c65-2248-4dcf-a845-2cf591dc530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0100f9-5080-42c4-940d-392f698ff256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Volume volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc (f9ad5a9c-2bf0-4721-9f84-2af3394276dc): created successfully Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a0100f9-5080-42c4-940d-392f698ff256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Flow 'volume_create_manager' (421c5c00-f924-4b83-a12c-26a63fe3fdb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:25 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-d6342e92-5fdf-414d-8d85-f64e0ee87112 req-a7675c20-415c-4ff0-8f62-4c131661f960 tempest-VolumesSnapshotsTestJSON-1980119636 None] Created volume successfully. Jun 29 03:01:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Creating offline snapshot cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b of volume f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:01:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ff63f5-fd8a-4e59-bf76-4fe2f0c5ca26]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:26 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc Jun 29 03:01:26 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:28 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" returned: 0 in 1.668s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:28 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b 1G Jun 29 03:01:28 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:30 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b 1G" returned: 0 in 2.029s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:30 devstack sudo[95826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b Jun 29 03:01:30 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:31 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" returned: 0 in 1.640s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:31 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b is being set with open permissions: ugo+rw Jun 29 03:01:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:32 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b Jun 29 03:01:32 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:33 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" returned: 0 in 1.573s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:33 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info Jun 29 03:01:33 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:34 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info" returned: 0 in 1.093s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:34 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info is being set with open permissions: ugo+rw Jun 29 03:01:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:34 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info Jun 29 03:01:34 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:35 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.info" returned: 0 in 0.861s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.113s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-0d588db9-e6c4-4b5f-ad4a-57b3d07761c2 req-6bc692d0-9ab7-4d4d-ba9f-a449d4333702 tempest-VolumesSnapshotsTestJSON-1980119636 None] Create snapshot completed successfully Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "cinder-cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "cinder-quobyte-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-quobyte-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "cinder-quobyte-cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-quobyte-cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Deleting offline snapshot cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b of volume f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] snapshot_file for this snap is: volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e2d943-e7ca-4bf5-a312-ffeb20545ff2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:36 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b Jun 29 03:01:36 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:36 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" returned: 0 in 0.840s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:01:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d372368-1498-40d0-a419-4eb4046199a4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:36 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc Jun 29 03:01:36 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:37 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" returned: 0 in 0.973s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:37 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b Jun 29 03:01:37 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:38 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" returned: 0 in 1.018s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:38 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b Jun 29 03:01:38 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:39 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc.cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-quobyte-cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b" released by "_delete_snapshot" :: held 3.782s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-quobyte-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" released by "delete_snapshot" :: held 3.815s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:39 devstack cinder-volume[93518]: WARNING cinder.quota [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:01:39 devstack cinder-volume[93518]: DEBUG cinder.quota [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Created reservations ['7b4b0d2a-176d-483b-80bf-c6a2f4d01d1b', 'a4c1c8cc-6804-40c6-8bed-414d981b3701', '2a0c1d54-a7a5-4102-9f39-c9e1dcf34945', '1177ac05-e37d-4b70-810c-668110bf4269'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:01:39 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Delete snapshot completed successfully. Jun 29 03:01:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-6c153a1b-a89a-4512-8fb6-38864f7f6961 req-4a6ecfda-f63f-4b2c-a520-593ae84df264 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-cb00fe8e-6975-4c5f-9a3e-ed1cf1fe6e5b-delete_snapshot" released by "delete_snapshot" :: held 4.028s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "cinder-f9ad5a9c-2bf0-4721-9f84-2af3394276dc-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-f9ad5a9c-2bf0-4721-9f84-2af3394276dc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "cinder-quobyte-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-quobyte-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3279c-e2bf-464c-93f0-e8a4f793e0c4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:40 devstack sudo[95897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc Jun 29 03:01:40 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:41 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" returned: 0 in 0.926s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:41 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc Jun 29 03:01:41 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:42 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" returned: 0 in 0.661s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-quobyte-f9ad5a9c-2bf0-4721-9f84-2af3394276dc" released by "delete_volume" :: held 1.714s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG cinder.quota [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Created reservations ['67d4abe4-79a6-4a88-b39a-ee6e65b4315b', 'fa3e199b-73f6-455c-9cc9-ff5c5c738448', '23340104-2069-4501-b6c1-62f093ee05e4', '340f1bba-ac0f-47e8-af2e-9ca80bfce3b2'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:42 devstack sudo[95941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:01:42 devstack sudo[95941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:43 devstack sudo[95941]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.658s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:43 devstack cinder-volume[93518]: DEBUG cinder.manager [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:01:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Deleted volume successfully. Jun 29 03:01:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-b0bb0715-4742-40af-b29c-ffdd2c05d1fd req-a0a2bc6c-70e8-4547-95ef-a8d4a1ff8b58 tempest-VolumesSnapshotsTestJSON-1980119636 None] Lock "cinder-f9ad5a9c-2bf0-4721-9f84-2af3394276dc-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Flow 'volume_create_manager' (b3a0d2c6-2945-469b-b68e-bd4b9e2a6c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc3521c-348f-438a-975b-14dedb484a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bc3521c-348f-438a-975b-14dedb484a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1964363652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0a88b8f32194ee180a9b9a18965af7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:47Z,use_quota=True,user_id='d6dae06370da4e99bf29fbdfbc3caebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5da43d-cc18-42c8-a01f-c1bf8ce364f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf5da43d-cc18-42c8-a01f-c1bf8ce364f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea61458-4129-4710-aac7-e7cda1f63540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea61458-4129-4710-aac7-e7cda1f63540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb', 'volume_name': 'volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4c3668-9a88-491b-8a29-1d25bc7c97d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4c3668-9a88-491b-8a29-1d25bc7c97d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fb96ab-331b-452e-a34f-5b264eee5e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:47 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Volume 82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb', 'volume_size': 1} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1964363652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0a88b8f32194ee180a9b9a18965af7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:47Z,use_quota=True,user_id='d6dae06370da4e99bf29fbdfbc3caebf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Creating volume 82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:01:47 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:01:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:47 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb 1073741824 Jun 29 03:01:47 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:48 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb 1073741824" returned: 0 in 1.135s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:48 devstack sudo[96039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb Jun 29 03:01:48 devstack sudo[96039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:49 devstack sudo[96039]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb" returned: 0 in 0.768s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fb96ab-331b-452e-a34f-5b264eee5e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf87bbc9-406f-49c8-988f-4d894e6362f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Volume volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb (82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb): created successfully Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf87bbc9-406f-49c8-988f-4d894e6362f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Flow 'volume_create_manager' (b3a0d2c6-2945-469b-b68e-bd4b9e2a6c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-fb9e195f-515f-4e8f-8ca6-672df1b7bdae req-1ef00c18-1b53-4654-bf28-fc538ccabf8f tempest-VolumesGetTestJSON-69874713 None] Created volume successfully. Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Acquiring lock "cinder-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Lock "cinder-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Acquiring lock "cinder-quobyte-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:01:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Lock "cinder-quobyte-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:01:50 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4f56cf-9e7c-47a2-b23b-7a59149b4a62]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:50 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb Jun 29 03:01:50 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:51 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb" returned: 0 in 1.127s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:51 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb Jun 29 03:01:51 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Flow 'volume_create_manager' (2419dbb7-ed56-4538-82fa-061a916a0241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2a536e-6da9-46f5-909d-d999b68b1408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2a536e-6da9-46f5-909d-d999b68b1408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1379641592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb3d1a1-591c-447c-96d1-52ddd9c9caf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8861f4f5954bb0ba7fbaa000e5c853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:51Z,use_quota=True,user_id='3ef416664e13423ebe1c744852b17ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ebe768-e20f-4bb9-8de1-44bdb37fd993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ebe768-e20f-4bb9-8de1-44bdb37fd993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdda351-4a1c-4ab6-9bfa-cb019a775ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdda351-4a1c-4ab6-9bfa-cb019a775ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb3d1a1-591c-447c-96d1-52ddd9c9caf5', 'volume_name': 'volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2394ef4-031f-413f-87db-1dfd2720ae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2394ef4-031f-413f-87db-1dfd2720ae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc5fe5b-be0a-4c79-920e-29800006ad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Volume ccb3d1a1-591c-447c-96d1-52ddd9c9caf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5', 'volume_size': 1} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1379641592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb3d1a1-591c-447c-96d1-52ddd9c9caf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8861f4f5954bb0ba7fbaa000e5c853',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:51Z,use_quota=True,user_id='3ef416664e13423ebe1c744852b17ed1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Creating volume ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:01:51 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:51 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 1073741824 Jun 29 03:01:51 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:51 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb" returned: 0 in 0.765s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Lock "cinder-quobyte-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb" released by "delete_volume" :: held 1.941s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG cinder.quota [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Created reservations ['91dbdcbc-688b-43aa-8985-01e9ee698a01', 'ebc4b020-2a5c-4ec6-8293-7c681cba2ba3', '6b62bd81-dd45-49f5-a03e-df3dcf7c77c6', '5ef74103-7e49-41d9-bbe6-948a7798d1f0'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:52 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:01:52 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:52 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 1073741824" returned: 0 in 1.397s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:53 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 Jun 29 03:01:53 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:53 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.652s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:53 devstack cinder-volume[93518]: DEBUG cinder.manager [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:01:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Deleted volume successfully. Jun 29 03:01:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-75ed3cdd-d324-4f1f-bc98-bbde88285279 req-fd0c8dbb-1db5-4057-b2c5-c8af5bc9df17 tempest-VolumesGetTestJSON-69874713 None] Lock "cinder-82e8bae6-6eab-43ea-bb7c-dccfdd7fb5cb-delete_volume" released by "delete_volume" :: held 3.847s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:01:54 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" returned: 0 in 1.076s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] <== create_volume: return (2558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc5fe5b-be0a-4c79-920e-29800006ad89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b634fcc-c95c-4b25-b664-7c3bf8adae35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:54 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Volume volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 (ccb3d1a1-591c-447c-96d1-52ddd9c9caf5): created successfully Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b634fcc-c95c-4b25-b664-7c3bf8adae35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Flow 'volume_create_manager' (2419dbb7-ed56-4538-82fa-061a916a0241) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f393fe06-1c78-422d-9a8e-51919a00e34c tempest-DeleteServersTestJSON-527607396 None] Created volume successfully. Jun 29 03:01:54 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Flow 'volume_create_manager' (eb898957-2141-43f6-b50c-d3ebdb41657e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd18f0d-1bc6-4714-96a3-ad2c87307032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd18f0d-1bc6-4714-96a3-ad2c87307032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-846329975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75eee245-7054-4272-a0ec-099b8121a9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882a3fc83f474f80804c6bedfd7cf3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:55Z,use_quota=True,user_id='becb9d0276a04d4388e6322957fcf366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d31393-1f4f-4deb-88e3-a99a3e35d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73d31393-1f4f-4deb-88e3-a99a3e35d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f52d9-0a47-4ac6-8c06-398ce5ef236b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f52d9-0a47-4ac6-8c06-398ce5ef236b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75eee245-7054-4272-a0ec-099b8121a9b0', 'volume_name': 'volume-75eee245-7054-4272-a0ec-099b8121a9b0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d300b6c-fc5d-40c2-ab6b-0704be942432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d300b6c-fc5d-40c2-ab6b-0704be942432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f3bc95-575f-4a44-a736-791de7386292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:55 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Volume 75eee245-7054-4272-a0ec-099b8121a9b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75eee245-7054-4272-a0ec-099b8121a9b0', 'volume_size': 1} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-846329975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75eee245-7054-4272-a0ec-099b8121a9b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='882a3fc83f474f80804c6bedfd7cf3fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:01:55Z,use_quota=True,user_id='becb9d0276a04d4388e6322957fcf366',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Creating volume 75eee245-7054-4272-a0ec-099b8121a9b0 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:01:55 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:01:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:55 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 1073741824 Jun 29 03:01:55 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:56 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 1073741824" returned: 0 in 1.420s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:56 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 Jun 29 03:01:56 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:01:57 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0" returned: 0 in 1.222s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] <== create_volume: return (2747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.750s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f3bc95-575f-4a44-a736-791de7386292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75eee245-7054-4272-a0ec-099b8121a9b0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672507f4-9569-47a5-8327-6576c1dafe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:01:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Volume volume-75eee245-7054-4272-a0ec-099b8121a9b0 (75eee245-7054-4272-a0ec-099b8121a9b0): created successfully Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672507f4-9569-47a5-8327-6576c1dafe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:01:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Flow 'volume_create_manager' (eb898957-2141-43f6-b50c-d3ebdb41657e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:01:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4a3efff3-60f3-42f1-a60f-eb1fde638a64 tempest-ServerActionsTestOtherA-1266192730 None] Created volume successfully. Jun 29 03:01:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:01:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:01:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[39829b77-f1ca-47df-a6bc-302b3d91bf1c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:01:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:01:59 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 Jun 29 03:01:59 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:00 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" returned: 0 in 1.550s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.613s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Flow 'volume_create_manager' (15cb4f52-fd41-4e29-9043-b7f03eaf89ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81195bf0-308b-4b30-8dd7-cb0c4be694d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd66d79a5-2403-4f11-9ec2-4d92123d52ae', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81195bf0-308b-4b30-8dd7-cb0c4be694d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-967485377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5990b44-1c94-4473-b95f-0db28fd552ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b7d9ee557d4b2693cafcbc6da34c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:00Z,use_quota=True,user_id='d7aa3617db0d4d30bfd2941009268db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548a95b3-089e-46ab-a1f8-2ea2a1ec0d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548a95b3-089e-46ab-a1f8-2ea2a1ec0d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd27c4d3-2de6-402f-bf6b-1c0715ccbe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd27c4d3-2de6-402f-bf6b-1c0715ccbe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5990b44-1c94-4473-b95f-0db28fd552ff', 'volume_name': 'volume-e5990b44-1c94-4473-b95f-0db28fd552ff', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c662ddc-b5a1-4ea4-9e4b-c42a9bc7ac0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c662ddc-b5a1-4ea4-9e4b-c42a9bc7ac0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bcfccc-c4ef-4f5b-898c-d9c3f8dfc7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:00 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Volume e5990b44-1c94-4473-b95f-0db28fd552ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5990b44-1c94-4473-b95f-0db28fd552ff', 'volume_size': 1} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-967485377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5990b44-1c94-4473-b95f-0db28fd552ff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b7d9ee557d4b2693cafcbc6da34c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:00Z,use_quota=True,user_id='d7aa3617db0d4d30bfd2941009268db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Creating volume e5990b44-1c94-4473-b95f-0db28fd552ff {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:02:00 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:02:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:00 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff 1073741824 Jun 29 03:02:00 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-c24676cf-e88d-4daf-972f-48bbcd04d1b5 req-5108c918-88a2-45c4-a2c3-bb4ac76a0220 tempest-DeleteServersTestJSON-527607396 None] attachment_update completed successfully. Jun 29 03:02:02 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff 1073741824" returned: 0 in 1.542s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:02 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff Jun 29 03:02:02 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:02 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff" returned: 0 in 0.664s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] <== create_volume: return (2291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19bcfccc-c4ef-4f5b-898c-d9c3f8dfc7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5990b44-1c94-4473-b95f-0db28fd552ff', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49199e61-2853-496f-ad1b-1863f9089757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Volume volume-e5990b44-1c94-4473-b95f-0db28fd552ff (e5990b44-1c94-4473-b95f-0db28fd552ff): created successfully Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49199e61-2853-496f-ad1b-1863f9089757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Flow 'volume_create_manager' (15cb4f52-fd41-4e29-9043-b7f03eaf89ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c86e69fb-7f6a-4147-b42c-0a68de1ed3b7 tempest-VolumesTestJSON-1346019749 None] Created volume successfully. Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Flow 'volume_create_manager' (daffc743-0f7b-477d-88a2-13c2dad5b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7b56e5-793e-41a8-a083-bc1a28a00734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7b56e5-793e-41a8-a083-bc1a28a00734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-135414929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea8982d-1009-43c0-849a-0abf8222bb82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b7d9ee557d4b2693cafcbc6da34c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:04Z,use_quota=True,user_id='d7aa3617db0d4d30bfd2941009268db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f6a04a-62ab-4cbc-9f9d-1d659ccf2266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f6a04a-62ab-4cbc-9f9d-1d659ccf2266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0f92e3-cd61-43ca-8d31-147e02171843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c0f92e3-cd61-43ca-8d31-147e02171843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea8982d-1009-43c0-849a-0abf8222bb82', 'volume_name': 'volume-7ea8982d-1009-43c0-849a-0abf8222bb82', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67ace9-0a8c-4502-a0fd-02c80a0f2fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed67ace9-0a8c-4502-a0fd-02c80a0f2fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2edf4a4-015c-439e-a8b9-75f096aa1ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Volume 7ea8982d-1009-43c0-849a-0abf8222bb82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea8982d-1009-43c0-849a-0abf8222bb82', 'volume_size': 1} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-135414929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea8982d-1009-43c0-849a-0abf8222bb82,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b7d9ee557d4b2693cafcbc6da34c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:04Z,use_quota=True,user_id='d7aa3617db0d4d30bfd2941009268db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Creating volume 7ea8982d-1009-43c0-849a-0abf8222bb82 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:02:04 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:04 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 1073741824 Jun 29 03:02:04 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-fa2dbba0-d0f8-4069-b880-658f01705e30 req-197aa241-ee09-49c3-9576-168bfb8efa64 tempest-AttachVolumeNegativeTest-2146070891 None] Terminate volume connection completed successfully. Jun 29 03:02:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-fa2dbba0-d0f8-4069-b880-658f01705e30 req-197aa241-ee09-49c3-9576-168bfb8efa64 tempest-AttachVolumeNegativeTest-2146070891 None] Deleting attachment 4a131d9d-0efd-4189-9afa-c442868ced66. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:02:05 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 1073741824" returned: 0 in 0.907s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:05 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 Jun 29 03:02:05 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:06 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82" returned: 0 in 0.676s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2edf4a4-015c-439e-a8b9-75f096aa1ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea8982d-1009-43c0-849a-0abf8222bb82', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cdcd50-6459-401c-ab16-a2119b2c0375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Volume volume-7ea8982d-1009-43c0-849a-0abf8222bb82 (7ea8982d-1009-43c0-849a-0abf8222bb82): created successfully Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9cdcd50-6459-401c-ab16-a2119b2c0375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Flow 'volume_create_manager' (daffc743-0f7b-477d-88a2-13c2dad5b996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:06 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f448487f-d33d-473f-8f22-b9f1f695bfec tempest-VolumesTestJSON-1346019749 None] Created volume successfully. Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Flow 'volume_create_manager' (6ad3a6b4-edf0-44d6-ae2c-7d6e35463e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df56c30f-31ce-4704-abb1-c6f64402bd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df56c30f-31ce-4704-abb1-c6f64402bd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-456782127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a0f178-1fc6-47d3-b5e3-49d80e940494,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b7d9ee557d4b2693cafcbc6da34c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:07Z,use_quota=True,user_id='d7aa3617db0d4d30bfd2941009268db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b441d055-8efd-4897-a2bf-05f329889660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b441d055-8efd-4897-a2bf-05f329889660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036a7732-d54d-49ab-a7ba-ad5d5ca1c8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036a7732-d54d-49ab-a7ba-ad5d5ca1c8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6a0f178-1fc6-47d3-b5e3-49d80e940494', 'volume_name': 'volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e30b9df-7916-49b8-9f75-fe4bb587bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e30b9df-7916-49b8-9f75-fe4bb587bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20808ba-ad0f-49dc-b538-a035a8760d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:07 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Volume e6a0f178-1fc6-47d3-b5e3-49d80e940494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494', 'volume_size': 1} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-456782127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6a0f178-1fc6-47d3-b5e3-49d80e940494,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b7d9ee557d4b2693cafcbc6da34c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:07Z,use_quota=True,user_id='d7aa3617db0d4d30bfd2941009268db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Creating volume e6a0f178-1fc6-47d3-b5e3-49d80e940494 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:02:07 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:02:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:07 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 1073741824 Jun 29 03:02:07 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:08 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 1073741824" returned: 0 in 1.279s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:08 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 Jun 29 03:02:08 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:09 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494" returned: 0 in 0.673s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20808ba-ad0f-49dc-b538-a035a8760d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4976606f-d43d-4571-8f49-515e6a2e3572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:09 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Volume volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 (e6a0f178-1fc6-47d3-b5e3-49d80e940494): created successfully Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4976606f-d43d-4571-8f49-515e6a2e3572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Flow 'volume_create_manager' (6ad3a6b4-edf0-44d6-ae2c-7d6e35463e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1b76e25c-1c94-45fc-995d-2cc58dbab359 tempest-VolumesTestJSON-1346019749 None] Created volume successfully. Jun 29 03:02:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-dddfef77-1b6f-4f08-ada2-77b88708016b req-dbcb204d-7683-49ad-9f92-8cd800383259 tempest-DeleteServersTestJSON-527607396 None] Terminate volume connection completed successfully. Jun 29 03:02:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-dddfef77-1b6f-4f08-ada2-77b88708016b req-dbcb204d-7683-49ad-9f92-8cd800383259 tempest-DeleteServersTestJSON-527607396 None] Deleting attachment d66d79a5-2403-4f11-9ec2-4d92123d52ae. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:02:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "cinder-e6a0f178-1fc6-47d3-b5e3-49d80e940494-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-e6a0f178-1fc6-47d3-b5e3-49d80e940494-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "cinder-quobyte-e6a0f178-1fc6-47d3-b5e3-49d80e940494" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-quobyte-e6a0f178-1fc6-47d3-b5e3-49d80e940494" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:12 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9347d057-c711-478d-9a2a-a55002e270be]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:12 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 Jun 29 03:02:12 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:12 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494" returned: 0 in 0.781s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:12 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494 Jun 29 03:02:12 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Acquiring lock "cinder-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Lock "cinder-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Acquiring lock "cinder-quobyte-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Lock "cinder-quobyte-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e2f053-0030-461a-b4e1-451d997fc877]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:13 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6a0f178-1fc6-47d3-b5e3-49d80e940494" returned: 0 in 0.721s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-quobyte-e6a0f178-1fc6-47d3-b5e3-49d80e940494" released by "delete_volume" :: held 1.566s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:13 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 Jun 29 03:02:13 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Created reservations ['e380e50d-ba53-43f9-8251-49e8c7edf414', 'e0b5ce0e-abd8-4679-9a5f-2f35096fcf87', '083e79cd-2cd6-41bb-850b-818b63c05193', '0b6760de-c977-4708-a1cd-c3ea776a88b9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:13 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:02:13 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "cinder-7ea8982d-1009-43c0-849a-0abf8222bb82-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-7ea8982d-1009-43c0-849a-0abf8222bb82-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "cinder-quobyte-7ea8982d-1009-43c0-849a-0abf8222bb82" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-quobyte-7ea8982d-1009-43c0-849a-0abf8222bb82" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c6d00c-d30e-4bbd-b1cc-e73755e1206d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:14 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" returned: 0 in 0.824s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:14 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.648s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:02:14 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5 Jun 29 03:02:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Deleted volume successfully. Jun 29 03:02:14 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b2dee103-59fb-48a6-8d27-25521e257468 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-e6a0f178-1fc6-47d3-b5e3-49d80e940494-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:14 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 Jun 29 03:02:14 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:15 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" returned: 0 in 0.673s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Lock "cinder-quobyte-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5" released by "delete_volume" :: held 1.540s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=57,cinder:DELETE=7 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Created reservations ['642dbdf5-1df5-4b97-b066-14ffc483d070', '09f64b6b-487f-4d48-b3f7-bdc2e1d5a177', 'd75536ef-5180-4f8e-8754-c1e3b443a02c', '2e2f69f0-fb44-435a-ac62-eb35de865571'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:15 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82" returned: 0 in 0.947s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:15 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:02:15 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:15 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82 Jun 29 03:02:15 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:16 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ea8982d-1009-43c0-849a-0abf8222bb82" returned: 0 in 0.736s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-quobyte-7ea8982d-1009-43c0-849a-0abf8222bb82" released by "delete_volume" :: held 1.730s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:16 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.796s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:02:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Deleted volume successfully. Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=59,cinder:SELECT=53,cinder:DELETE=4,cinder:INSERT=13 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6aa442b1-7059-4798-b602-89237e634e6e tempest-DeleteServersTestJSON-527607396 None] Lock "cinder-ccb3d1a1-591c-447c-96d1-52ddd9c9caf5-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Created reservations ['d577e818-c0dd-415a-9633-dc563d99d67e', 'bedd7cbb-c9c3-4278-ad70-51db3e6a5149', '7f28083a-31bc-4378-a685-4c43929a1f45', 'a2716e1c-a74a-4227-bc02-1457a4de3cf3'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:16 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:02:16 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "cinder-e5990b44-1c94-4473-b95f-0db28fd552ff-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-e5990b44-1c94-4473-b95f-0db28fd552ff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "cinder-quobyte-e5990b44-1c94-4473-b95f-0db28fd552ff" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-quobyte-e5990b44-1c94-4473-b95f-0db28fd552ff" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1678c3e-70d6-4769-8312-541895a3287c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:17 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff Jun 29 03:02:17 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:17 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.211s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:02:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Deleted volume successfully. Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77882270-154b-4519-9ef3-a2de91b372b4 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-7ea8982d-1009-43c0-849a-0abf8222bb82-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:17 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:02:17 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff" returned: 0 in 1.446s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:18 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:18 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff Jun 29 03:02:18 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:18 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.192s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:02:19 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e5990b44-1c94-4473-b95f-0db28fd552ff" returned: 0 in 1.100s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-quobyte-e5990b44-1c94-4473-b95f-0db28fd552ff" released by "delete_volume" :: held 2.622s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Created reservations ['f7bf8268-7329-41b8-b664-52c3a847a900', '6d2a3b48-2a82-406d-b6ce-e5e383e91635', 'ba631d4a-5c58-437b-8e2f-5e4cda270f9f', 'b922614d-af60-4784-9680-0249c1aa34d5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:19 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:02:19 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:20 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.408s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:20 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:02:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Deleted volume successfully. Jun 29 03:02:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53944d9a-9750-42ba-aa29-d61bfd2f5aa6 tempest-VolumesTestJSON-1346019749 None] Lock "cinder-e5990b44-1c94-4473-b95f-0db28fd552ff-delete_volume" released by "delete_volume" :: held 4.366s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53646dd9-9b69-432a-8d04-1ecdd07313f5 tempest-GroupSnapshotsTest-1168059695 None] Group tempest-GroupSnapshotsTest-Group-763597432: creating Jun 29 03:02:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53646dd9-9b69-432a-8d04-1ecdd07313f5 tempest-GroupSnapshotsTest-1168059695 None] Group tempest-GroupSnapshotsTest-Group-763597432: created successfully Jun 29 03:02:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53646dd9-9b69-432a-8d04-1ecdd07313f5 tempest-GroupSnapshotsTest-1168059695 None] Create group completed successfully. Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (4683348b-b700-48dd-b755-588f6f6885e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9860a8-655c-4a62-952d-ba1ceb7efd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9860a8-655c-4a62-952d-ba1ceb7efd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330162591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=801e1755-91c7-4cbf-8653-f4ac4d9012fc,host='devstack@QuobyteHD#QuobyteHD',id=741bc8cb-bd76-402e-8631-aa275c5725ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:29Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bd17ad-94a8-4bee-b7db-e77bea78d348),volume_type_id=21bd17ad-94a8-4bee-b7db-e77bea78d348)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3497435-2013-4d61-8076-b5f58406205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3497435-2013-4d61-8076-b5f58406205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b33df4-b204-4b69-9a61-ab78321c1b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b33df4-b204-4b69-9a61-ab78321c1b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741bc8cb-bd76-402e-8631-aa275c5725ed', 'volume_name': 'volume-741bc8cb-bd76-402e-8631-aa275c5725ed', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc234830-c281-4dd2-8d3e-6ad50c7197de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc234830-c281-4dd2-8d3e-6ad50c7197de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914e888b-7b7a-457c-b3d9-8f4af6a331d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:29 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Volume 741bc8cb-bd76-402e-8631-aa275c5725ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741bc8cb-bd76-402e-8631-aa275c5725ed', 'volume_size': 1} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=801e1755-91c7-4cbf-8653-f4ac4d9012fc,created_at=2026-06-29T01:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330162591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=801e1755-91c7-4cbf-8653-f4ac4d9012fc,host='devstack@QuobyteHD#QuobyteHD',id=741bc8cb-bd76-402e-8631-aa275c5725ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:29Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21bd17ad-94a8-4bee-b7db-e77bea78d348),volume_type_id=21bd17ad-94a8-4bee-b7db-e77bea78d348)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Creating volume 741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:02:29 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:02:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:29 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed 1073741824 Jun 29 03:02:29 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:30 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed 1073741824" returned: 0 in 1.508s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:30 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:02:30 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:31 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 0.952s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] <== create_volume: return (2532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.538s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914e888b-7b7a-457c-b3d9-8f4af6a331d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741bc8cb-bd76-402e-8631-aa275c5725ed', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95469a9-f361-4066-b004-5baf0ef96135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:31 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Volume volume-741bc8cb-bd76-402e-8631-aa275c5725ed (741bc8cb-bd76-402e-8631-aa275c5725ed): created successfully Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f95469a9-f361-4066-b004-5baf0ef96135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (4683348b-b700-48dd-b755-588f6f6885e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-545edb8b-5f5d-4b7a-a00d-e8c045e5a7f6 tempest-GroupSnapshotsTest-1168059695 None] Created volume successfully. Jun 29 03:02:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] GroupSnapshot 8f6699a3-c9d9-411b-b934-c828d7a2e7db: creating. Jun 29 03:02:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Group snapshot 8f6699a3-c9d9-411b-b934-c828d7a2e7db: creating. {{(pid=93518) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:02:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Creating offline snapshot 9f41b2be-054b-4cd6-ae11-e6cc1369a88a of volume 741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:02:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b7caf9-a471-47b2-a2e0-ae1f9fb4c21d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:33 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:02:33 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:34 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 0.981s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:34 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a 1G Jun 29 03:02:34 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:35 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a 1G" returned: 0 in 0.998s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741bc8cb-bd76-402e-8631-aa275c5725ed -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:35 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741bc8cb-bd76-402e-8631-aa275c5725ed -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a Jun 29 03:02:35 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:36 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741bc8cb-bd76-402e-8631-aa275c5725ed -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a" returned: 0 in 0.941s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:36 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:02:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:36 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a Jun 29 03:02:36 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:37 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a" returned: 0 in 0.658s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:37 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info Jun 29 03:02:37 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:38 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info" returned: 0 in 0.896s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:38 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:02:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:38 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info Jun 29 03:02:38 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:39 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.info" returned: 0 in 1.258s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.853s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:39 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-289695bb-3550-4797-babf-b022bd295a62 tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 8f6699a3-c9d9-411b-b934-c828d7a2e7db: created successfully Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-9f41b2be-054b-4cd6-ae11-e6cc1369a88a-8309966e-7959-4750-b35d-df854017605c" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-9f41b2be-054b-4cd6-ae11-e6cc1369a88a-8309966e-7959-4750-b35d-df854017605c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Creating volume 8309966e-7959-4750-b35d-df854017605c from snapshot 9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-8309966e-7959-4750-b35d-df854017605c" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-8309966e-7959-4750-b35d-df854017605c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] snapshot: 9f41b2be-054b-4cd6-ae11-e6cc1369a88a, volume: 8309966e-7959-4750-b35d-df854017605c, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb985d-a7f5-48c8-8244-8a18501fc108]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:41 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a Jun 29 03:02:41 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:42 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a" returned: 0 in 0.820s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-741bc8cb-bd76-402e-8631-aa275c5725ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[df819670-3347-4c07-8ed9-817479a4527c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:42 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:02:42 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:42 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 0.840s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:43 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:02:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:43 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c Jun 29 03:02:43 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c" returned: 0 in 6.911s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:49 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb211ef4-9254-4d9b-8575-dbb962c37a79]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:50 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:02:50 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=25,cinder:INSERT=11,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:02:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=26,cinder:DELETE=1,cinder:SELECT=18,cinder:INSERT=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:02:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:51 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 1.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:51 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:02:51 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Converted 1024.00 MB image at 148.13 MB/s Jun 29 03:02:51 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:02:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:51 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c Jun 29 03:02:51 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:52 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c" returned: 0 in 1.118s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-8309966e-7959-4750-b35d-df854017605c" released by "_copy_volume_from_snapshot" :: held 11.589s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-9f41b2be-054b-4cd6-ae11-e6cc1369a88a-8309966e-7959-4750-b35d-df854017605c" released by "_create_volume_from_snapshot" :: held 11.641s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.660s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.444s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4913d6-c13c-426f-a384-c5136b98b05e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0be7069f-3f08-47a3-81d4-06b0d051209d tempest-GroupSnapshotsTest-1168059695 None] Create group from source-snapshot-8f6699a3-c9d9-411b-b934-c828d7a2e7db completed successfully. Jun 29 03:02:53 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 Jun 29 03:02:53 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:54 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0" returned: 0 in 1.326s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.371s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-75eee245-7054-4272-a0ec-099b8121a9b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f62ca90-3d2a-4e83-8dfe-f7020b702126', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:02:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-563217a3-5977-4080-b7e7-cba7bdc596f0 req-dc3f915b-650e-4a4f-8b66-b27cf992c723 tempest-ServerActionsTestOtherA-1266192730 None] attachment_update completed successfully. Jun 29 03:02:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-8309966e-7959-4750-b35d-df854017605c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-8309966e-7959-4750-b35d-df854017605c" acquired by "delete_volume" :: waited 0.064s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:55 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecbed89-7363-4b51-ad25-5f01bebe504e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:55 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c Jun 29 03:02:55 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:56 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c" returned: 0 in 1.453s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:56 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c Jun 29 03:02:56 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Flow 'volume_create_manager' (3715b229-0727-4abf-a53e-58ea90d76999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:57 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12996fcb-7d24-4c5e-8d5b-13cafebb0d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12996fcb-7d24-4c5e-8d5b-13cafebb0d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-933059172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b217fc78-b30e-4413-9810-c7024d6da67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbc552494304c20a21e77c633c3ad54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:57Z,use_quota=True,user_id='e98f70dee92b408388e9ec79ac004b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e570a3-53eb-4eb7-9164-0993c35f7d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e570a3-53eb-4eb7-9164-0993c35f7d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984578cc-a574-4e0d-90a3-40c1c8ce1b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (984578cc-a574-4e0d-90a3-40c1c8ce1b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b217fc78-b30e-4413-9810-c7024d6da67e', 'volume_name': 'volume-b217fc78-b30e-4413-9810-c7024d6da67e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5f34d0-1ad3-40f7-bf90-e2c6243d4ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5f34d0-1ad3-40f7-bf90-e2c6243d4ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271ab48e-5b8c-4cee-80ad-250b3fe29f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Volume b217fc78-b30e-4413-9810-c7024d6da67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b217fc78-b30e-4413-9810-c7024d6da67e', 'volume_size': 1} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:02:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-933059172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b217fc78-b30e-4413-9810-c7024d6da67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcbc552494304c20a21e77c633c3ad54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:02:57Z,use_quota=True,user_id='e98f70dee92b408388e9ec79ac004b4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Creating volume b217fc78-b30e-4413-9810-c7024d6da67e {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:02:57 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8309966e-7959-4750-b35d-df854017605c" returned: 0 in 0.983s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:57 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e 1073741824 Jun 29 03:02:57 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-8309966e-7959-4750-b35d-df854017605c" released by "delete_volume" :: held 2.573s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['26212583-9194-4639-a036-edc11593c831'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:02:57 devstack cinder-volume[93518]: WARNING cinder.quota [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1171706912 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1171706912, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:02:57 devstack cinder-volume[93518]: WARNING cinder.quota [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1171706912 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1171706912, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['8996f620-636d-45ba-9906-382f9acaad21', '2c86a92d-9695-4f51-ab8d-89213c67c29d', '7849d574-1b45-4dd9-8047-849cc1b5e47e', 'f10f9697-c380-4a7c-9edc-760949c62cf3'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:57 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:02:57 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:58 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e 1073741824" returned: 0 in 1.003s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:58 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e Jun 29 03:02:58 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:58 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.731s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:58 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:02:58 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ddca1fb9-41ce-4ff0-b8c2-e6133813cd30 tempest-GroupSnapshotsTest-1168059695 None] Delete group completed successfully. Jun 29 03:02:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 8f6699a3-c9d9-411b-b934-c828d7a2e7db: deleting Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 8f6699a3-c9d9-411b-b934-c828d7a2e7db: deleting {{(pid=93518) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-741bc8cb-bd76-402e-8631-aa275c5725ed" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-741bc8cb-bd76-402e-8631-aa275c5725ed" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-9f41b2be-054b-4cd6-ae11-e6cc1369a88a" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-9f41b2be-054b-4cd6-ae11-e6cc1369a88a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Deleting offline snapshot 9f41b2be-054b-4cd6-ae11-e6cc1369a88a of volume 741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] snapshot_file for this snap is: volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b000879-e640-41ae-bbd5-d24105057099]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:02:59 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e" returned: 0 in 0.641s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271ab48e-5b8c-4cee-80ad-250b3fe29f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b217fc78-b30e-4413-9810-c7024d6da67e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0c3717-9102-49d9-b58e-5e419400e495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:02:59 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a Jun 29 03:02:59 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:02:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Volume volume-b217fc78-b30e-4413-9810-c7024d6da67e (b217fc78-b30e-4413-9810-c7024d6da67e): created successfully Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0c3717-9102-49d9-b58e-5e419400e495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:02:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Flow 'volume_create_manager' (3715b229-0727-4abf-a53e-58ea90d76999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:02:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c0320018-31ee-4147-a0cb-9125ec909857 tempest-TaggedAttachmentsTest-1968115717 None] Created volume successfully. Jun 29 03:03:00 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a" returned: 0 in 1.041s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-741bc8cb-bd76-402e-8631-aa275c5725ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:03:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b839235a-7379-4a30-b52a-39666b26fbb3]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:00 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:03:00 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:01 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 1.337s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:01 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a Jun 29 03:03:01 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:02 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a" returned: 0 in 1.222s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:02 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a Jun 29 03:03:02 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:03 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed.9f41b2be-054b-4cd6-ae11-e6cc1369a88a" returned: 0 in 0.837s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-9f41b2be-054b-4cd6-ae11-e6cc1369a88a" released by "_delete_snapshot" :: held 4.604s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-741bc8cb-bd76-402e-8631-aa275c5725ed" released by "delete_snapshot" :: held 4.636s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:03 devstack cinder-volume[93518]: WARNING cinder.quota [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1171706912 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1171706912, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:03:03 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['fdb7dc7d-cbdd-4c21-ba06-360b056f982f', '6b61a7e6-18dc-43f5-8969-497a4a3af6ac', '79926827-966b-4930-b837-b3284d096dcc', '73afd6b6-c6f4-4ad7-adac-6d018dee6b07'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b76f0242-1535-4bbd-b4c5-b8d11d664bf2 tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 8f6699a3-c9d9-411b-b934-c828d7a2e7db: deleted successfully Jun 29 03:03:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-c69f09c7-6587-45d8-9ba8-d11a048bc53a tempest-ServerActionsTestOtherA-1266192730 None] Terminate volume connection completed successfully. Jun 29 03:03:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-c69f09c7-6587-45d8-9ba8-d11a048bc53a tempest-ServerActionsTestOtherA-1266192730 None] Deleting attachment 9f62ca90-3d2a-4e83-8dfe-f7020b702126. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:03:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-741bc8cb-bd76-402e-8631-aa275c5725ed" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-741bc8cb-bd76-402e-8631-aa275c5725ed" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:04 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7842d8-c5c2-40be-874f-c13a801cc387]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:05 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:03:05 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:05 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 0.774s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:05 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed Jun 29 03:03:05 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:06 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-741bc8cb-bd76-402e-8631-aa275c5725ed" returned: 0 in 0.710s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-741bc8cb-bd76-402e-8631-aa275c5725ed" released by "delete_volume" :: held 1.558s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['5cec3cab-5b32-46fd-881a-4f33eeffba8a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:06 devstack cinder-volume[93518]: WARNING cinder.db.api [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1171706912'] Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['02af1cc6-d7ff-405e-aa90-6771c54862ef', 'bf4cb81c-7f8c-45ae-a5d8-418fb5850132', 'cd4cdb07-4b47-410d-bbdb-bfa934e335b6', '4ffd94a9-4f7e-43fd-a315-3f6024de2314'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:06 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:03:06 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[91346609-58c8-4f8d-9aa5-5238532dd6ec]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:06 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 Jun 29 03:03:06 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:07 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.810s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:07 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:03:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-17167569-c04e-4fbd-aa1b-51bf1c780ac9 tempest-GroupSnapshotsTest-1168059695 None] Delete group completed successfully. Jun 29 03:03:07 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0" returned: 0 in 0.955s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.980s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-75eee245-7054-4272-a0ec-099b8121a9b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7bdea0b-a45e-4ff8-8437-012ecd8d0794', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:03:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ee08c87f-7ef5-4e97-9fb5-d6b125e1a11d tempest-GroupSnapshotsTest-1168059695 None] Group tempest-GroupSnapshotsTest-Group-652064731: creating Jun 29 03:03:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-d9959b0f-05e3-4775-9087-b6a514acb2ed req-15fa690a-7707-41ca-9675-1b7c0738db97 tempest-ServerActionsTestOtherA-1266192730 None] attachment_update completed successfully. Jun 29 03:03:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ee08c87f-7ef5-4e97-9fb5-d6b125e1a11d tempest-GroupSnapshotsTest-1168059695 None] Group tempest-GroupSnapshotsTest-Group-652064731: created successfully Jun 29 03:03:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ee08c87f-7ef5-4e97-9fb5-d6b125e1a11d tempest-GroupSnapshotsTest-1168059695 None] Create group completed successfully. Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (75fc8645-58de-431b-88ca-965b93099a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ec7e1-db37-43d8-9eb7-3f3ab02a44a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (577ec7e1-db37-43d8-9eb7-3f3ab02a44a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-145080601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba944a60-47f3-4a37-99a5-f912d53a39c3,host='devstack@QuobyteHD#QuobyteHD',id=fdb69e03-1e58-4ad8-adee-5971b780447b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:10Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea6405e-7dce-4e87-9356-6907edaffa4f),volume_type_id=aea6405e-7dce-4e87-9356-6907edaffa4f)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09639bc-cbe5-4721-a4b3-8060592d90c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09639bc-cbe5-4721-a4b3-8060592d90c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d802c58-9784-4594-ac20-c07f61f26880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d802c58-9784-4594-ac20-c07f61f26880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb69e03-1e58-4ad8-adee-5971b780447b', 'volume_name': 'volume-fdb69e03-1e58-4ad8-adee-5971b780447b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36808be3-1279-4ed2-b7df-f110c67d30af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36808be3-1279-4ed2-b7df-f110c67d30af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683a6d30-bcb1-4ab6-9067-0e80835bebc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:09 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Volume fdb69e03-1e58-4ad8-adee-5971b780447b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb69e03-1e58-4ad8-adee-5971b780447b', 'volume_size': 1} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba944a60-47f3-4a37-99a5-f912d53a39c3,created_at=2026-06-29T01:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-145080601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba944a60-47f3-4a37-99a5-f912d53a39c3,host='devstack@QuobyteHD#QuobyteHD',id=fdb69e03-1e58-4ad8-adee-5971b780447b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:10Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea6405e-7dce-4e87-9356-6907edaffa4f),volume_type_id=aea6405e-7dce-4e87-9356-6907edaffa4f)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Creating volume fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:03:09 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:03:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:09 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b 1073741824 Jun 29 03:03:09 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:11 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b 1073741824" returned: 0 in 1.138s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:11 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b Jun 29 03:03:11 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:11 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b" returned: 0 in 0.785s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] <== create_volume: return (1989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (683a6d30-bcb1-4ab6-9067-0e80835bebc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb69e03-1e58-4ad8-adee-5971b780447b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4912855d-ee3c-4eb9-8d1c-f7766ce77299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:11 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Volume volume-fdb69e03-1e58-4ad8-adee-5971b780447b (fdb69e03-1e58-4ad8-adee-5971b780447b): created successfully Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4912855d-ee3c-4eb9-8d1c-f7766ce77299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (75fc8645-58de-431b-88ca-965b93099a09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:11 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8ba18c83-d0d8-4f34-88dc-78b3f8840a70 tempest-GroupSnapshotsTest-1168059695 None] Created volume successfully. Jun 29 03:03:12 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:03:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (2178e8bf-8875-4d7b-835a-ee276f056a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a74cf-8479-4393-9597-a3ba85ea39ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a74cf-8479-4393-9597-a3ba85ea39ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-22813850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba944a60-47f3-4a37-99a5-f912d53a39c3,host='devstack@QuobyteHD#QuobyteHD',id=598fba88-ca57-4da2-8316-a4ebb4f3e284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:13Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea6405e-7dce-4e87-9356-6907edaffa4f),volume_type_id=aea6405e-7dce-4e87-9356-6907edaffa4f)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d890c00-b409-498f-9bc6-fd29d1407cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d890c00-b409-498f-9bc6-fd29d1407cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064f207b-5cc9-44d1-9af4-0cc10156715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064f207b-5cc9-44d1-9af4-0cc10156715d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598fba88-ca57-4da2-8316-a4ebb4f3e284', 'volume_name': 'volume-598fba88-ca57-4da2-8316-a4ebb4f3e284', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d7d1dd-8df4-4d46-a544-19348d5bff4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d7d1dd-8df4-4d46-a544-19348d5bff4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919279ea-9c28-4044-b088-07e969778a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:13 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Volume 598fba88-ca57-4da2-8316-a4ebb4f3e284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598fba88-ca57-4da2-8316-a4ebb4f3e284', 'volume_size': 1} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba944a60-47f3-4a37-99a5-f912d53a39c3,created_at=2026-06-29T01:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-22813850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba944a60-47f3-4a37-99a5-f912d53a39c3,host='devstack@QuobyteHD#QuobyteHD',id=598fba88-ca57-4da2-8316-a4ebb4f3e284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:13Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aea6405e-7dce-4e87-9356-6907edaffa4f),volume_type_id=aea6405e-7dce-4e87-9356-6907edaffa4f)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Creating volume 598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:03:13 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:13 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 1073741824 Jun 29 03:03:13 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:13 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 1073741824" returned: 0 in 0.823s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:13 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 Jun 29 03:03:13 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:14 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284" returned: 0 in 0.851s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919279ea-9c28-4044-b088-07e969778a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598fba88-ca57-4da2-8316-a4ebb4f3e284', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc05b183-0ea2-4131-ac90-d8883fc72d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:14 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Volume volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 (598fba88-ca57-4da2-8316-a4ebb4f3e284): created successfully Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc05b183-0ea2-4131-ac90-d8883fc72d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (2178e8bf-8875-4d7b-835a-ee276f056a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7fadb503-9069-4b1f-9353-899ba0ff1ca3 tempest-GroupSnapshotsTest-1168059695 None] Created volume successfully. Jun 29 03:03:15 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-33ab50d6-c905-415c-ad1a-eee0bddfc862 tempest-GroupSnapshotsTest-1168059695 None] Update group completed successfully. Jun 29 03:03:16 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:03:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Flow 'volume_create_manager' (ec554963-f5a5-42b9-8776-3aeb4f165a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1409eb44-d2f0-47af-bf28-b0669fd38d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1409eb44-d2f0-47af-bf28-b0669fd38d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1195915343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55d461f-eff5-4c77-a67a-4c1ec7532d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1936a5953384069ac064d1fa904b49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:17Z,use_quota=True,user_id='8a0f54da24f146f98fa2fcaf5b694ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0e8c60-024c-4578-8141-319e6f91df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0e8c60-024c-4578-8141-319e6f91df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccdd842-b58e-4dc5-a814-7091fa2f3aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ccdd842-b58e-4dc5-a814-7091fa2f3aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c55d461f-eff5-4c77-a67a-4c1ec7532d02', 'volume_name': 'volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5d6368-298d-4bb9-9d0d-ac6a8fcb1a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a5d6368-298d-4bb9-9d0d-ac6a8fcb1a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b5f2b-1ab1-4a43-9075-25ac283a0a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Volume c55d461f-eff5-4c77-a67a-4c1ec7532d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02', 'volume_size': 1} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1195915343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c55d461f-eff5-4c77-a67a-4c1ec7532d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1936a5953384069ac064d1fa904b49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:17Z,use_quota=True,user_id='8a0f54da24f146f98fa2fcaf5b694ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Creating volume c55d461f-eff5-4c77-a67a-4c1ec7532d02 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:03:17 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:17 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 1073741824 Jun 29 03:03:17 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1975a788-5262-46a3-93d3-c35c63810797 tempest-GroupSnapshotsTest-1168059695 None] Update group completed successfully. Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:17 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:03:17 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:18 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-51e860cd-b254-4818-aa42-bcc3756c656f tempest-GroupSnapshotsTest-1168059695 None] Update group completed successfully. Jun 29 03:03:18 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 1073741824" returned: 0 in 1.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:19 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.439s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:19 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:03:19 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:03:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 8 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:03:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:03:19 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 Jun 29 03:03:19 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8f356e20-8845-4fc5-b32c-df84395601d7 tempest-GroupSnapshotsTest-1168059695 None] Update group completed successfully. Jun 29 03:03:20 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02" returned: 0 in 1.414s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] <== create_volume: return (3368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.371s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96b5f2b-1ab1-4a43-9075-25ac283a0a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8dca7b-c6f0-47f0-a145-b8c81fa4a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:20 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Volume volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 (c55d461f-eff5-4c77-a67a-4c1ec7532d02): created successfully Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c8dca7b-c6f0-47f0-a145-b8c81fa4a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Flow 'volume_create_manager' (ec554963-f5a5-42b9-8776-3aeb4f165a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7de6e55e-95eb-4bb2-88a9-5f7372d623af tempest-AttachVolumeNegativeTest-2146070891 None] Created volume successfully. Jun 29 03:03:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] GroupSnapshot fc4149ce-93e2-45e3-8004-27a6608097a0: creating. Jun 29 03:03:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Group snapshot fc4149ce-93e2-45e3-8004-27a6608097a0: creating. {{(pid=93518) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:03:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Creating offline snapshot 1fa2e242-9803-4292-ab8c-1091431301f5 of volume 598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:03:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac5078e-b4a1-4819-b085-bdcdc4303869]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:22 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 Jun 29 03:03:22 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:23 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284" returned: 0 in 1.060s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:23 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 1G Jun 29 03:03:23 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:24 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 1G" returned: 0 in 1.267s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:24 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 Jun 29 03:03:24 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:25 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5" returned: 0 in 0.982s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:25 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:03:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:25 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 Jun 29 03:03:25 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:26 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5" returned: 0 in 0.677s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:26 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info Jun 29 03:03:26 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:26 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:26 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:03:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:26 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info Jun 29 03:03:26 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:27 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.info" returned: 0 in 0.665s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.426s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Creating offline snapshot 40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc of volume fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[602ed407-3161-44ec-a1d5-be1cbfb1daed]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:27 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b Jun 29 03:03:27 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:28 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b" returned: 0 in 0.801s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:28 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc 1G Jun 29 03:03:28 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:29 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc 1G" returned: 0 in 0.810s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb69e03-1e58-4ad8-adee-5971b780447b -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:29 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb69e03-1e58-4ad8-adee-5971b780447b -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc Jun 29 03:03:29 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:29 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb69e03-1e58-4ad8-adee-5971b780447b -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" returned: 0 in 0.759s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:29 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:03:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:29 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc Jun 29 03:03:29 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:30 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" returned: 0 in 0.722s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:30 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info Jun 29 03:03:30 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:31 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info" returned: 0 in 0.663s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:31 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:31 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info Jun 29 03:03:31 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:31 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.info" returned: 0 in 0.642s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.501s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.819s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[42305ea3-0bf6-42ff-b179-7cf618e51ae7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:32 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 Jun 29 03:03:32 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53d758dc-ec04-41b1-b16e-796ac3b70da4 tempest-GroupSnapshotsTest-1168059695 None] group_snapshot fc4149ce-93e2-45e3-8004-27a6608097a0: created successfully Jun 29 03:03:32 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02" returned: 0 in 0.780s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] group_snapshot fc4149ce-93e2-45e3-8004-27a6608097a0: deleting Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d887a8b-5652-49a9-8791-89da4922906d', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] group_snapshot fc4149ce-93e2-45e3-8004-27a6608097a0: deleting {{(pid=93518) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-598fba88-ca57-4da2-8316-a4ebb4f3e284" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-598fba88-ca57-4da2-8316-a4ebb4f3e284" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-1fa2e242-9803-4292-ab8c-1091431301f5" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-f05364d7-b309-4d88-b446-a031c376b607 req-d2bf3736-a896-4760-91b1-4ea49e572518 tempest-AttachVolumeNegativeTest-2146070891 None] attachment_update completed successfully. Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-1fa2e242-9803-4292-ab8c-1091431301f5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Deleting offline snapshot 1fa2e242-9803-4292-ab8c-1091431301f5 of volume 598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] snapshot_file for this snap is: volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b9c62d-5d28-4817-adf1-8ab7189aa12a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:33 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 Jun 29 03:03:33 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:33 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5" returned: 0 in 0.848s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-598fba88-ca57-4da2-8316-a4ebb4f3e284(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:03:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72e203d-11e1-4c3d-8eb2-c33429b34222]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:33 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 Jun 29 03:03:33 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:34 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284" returned: 0 in 0.829s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:34 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 Jun 29 03:03:34 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:35 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5" returned: 0 in 0.733s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:35 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5 Jun 29 03:03:35 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:36 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284.1fa2e242-9803-4292-ab8c-1091431301f5" returned: 0 in 0.680s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-1fa2e242-9803-4292-ab8c-1091431301f5" released by "_delete_snapshot" :: held 3.217s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-598fba88-ca57-4da2-8316-a4ebb4f3e284" released by "delete_snapshot" :: held 3.248s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-fdb69e03-1e58-4ad8-adee-5971b780447b" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-fdb69e03-1e58-4ad8-adee-5971b780447b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Deleting offline snapshot 40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc of volume fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] snapshot_file for this snap is: volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fcfb0b-aa00-4563-a400-3218ffc86ffc]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:36 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc Jun 29 03:03:36 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:37 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" returned: 0 in 0.817s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdb69e03-1e58-4ad8-adee-5971b780447b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:03:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[93957509-d803-41be-8ae8-5eb3683459e6]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:37 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b Jun 29 03:03:37 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:37 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:37 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc Jun 29 03:03:37 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:38 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" returned: 0 in 0.760s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:38 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc Jun 29 03:03:38 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:39 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b.40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" returned: 0 in 0.637s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-40d5b9da-0f94-4d4b-9fc6-7b091c0c33cc" released by "_delete_snapshot" :: held 3.151s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-fdb69e03-1e58-4ad8-adee-5971b780447b" released by "delete_snapshot" :: held 3.171s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:39 devstack cinder-volume[93518]: WARNING cinder.quota [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1917369628 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1917369628, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:03:39 devstack cinder-volume[93518]: WARNING cinder.quota [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1917369628 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1917369628, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:03:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['e3eb97b0-f1cb-4076-9a42-307efcc9eff6', 'd5999df0-d0cc-48c4-aabc-ebce43ec68cc', '9776bb39-d621-4602-88c9-c118cc612878', 'e285fd2c-1d91-4a5f-b163-864c2318c1bc'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['c7574302-2ee6-43c2-a3c2-e49772de5897', '47a593c2-8e30-452f-83bc-dc011ef8c51a', 'ba46e75e-caee-4758-b32a-1f0ce5dcd0ea', 'da47e42c-b5f3-4136-afb6-37db3e346609'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:39 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-001ffbff-b90d-4810-a736-8f99ed44a0df tempest-GroupSnapshotsTest-1168059695 None] group_snapshot fc4149ce-93e2-45e3-8004-27a6608097a0: deleted successfully Jun 29 03:03:39 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-7c5a3341-80d3-4e36-8f1a-fc30d2fea758 req-d2ed644c-e74a-4936-9c20-e284ced3f1db tempest-AttachVolumeNegativeTest-2146070891 None] Terminate volume connection completed successfully. Jun 29 03:03:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-7c5a3341-80d3-4e36-8f1a-fc30d2fea758 req-d2ed644c-e74a-4936-9c20-e284ced3f1db tempest-AttachVolumeNegativeTest-2146070891 None] Deleting attachment 2d887a8b-5652-49a9-8791-89da4922906d. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:03:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-598fba88-ca57-4da2-8316-a4ebb4f3e284" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-598fba88-ca57-4da2-8316-a4ebb4f3e284" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[774108aa-859e-458c-bcfe-01b58a044e7a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:41 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 Jun 29 03:03:41 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:41 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284" returned: 0 in 0.900s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:41 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284 Jun 29 03:03:41 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-a8baad3f-01e8-4e64-932b-feeb02279f43 req-7307ff82-4bf5-475b-9a4c-4611d329853d tempest-ServerActionsTestOtherA-1266192730 None] Terminate volume connection completed successfully. Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-a8baad3f-01e8-4e64-932b-feeb02279f43 req-7307ff82-4bf5-475b-9a4c-4611d329853d tempest-ServerActionsTestOtherA-1266192730 None] Deleting attachment f7bdea0b-a45e-4ff8-8437-012ecd8d0794. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:03:42 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-598fba88-ca57-4da2-8316-a4ebb4f3e284" returned: 0 in 0.820s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-598fba88-ca57-4da2-8316-a4ebb4f3e284" released by "delete_volume" :: held 1.804s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-fdb69e03-1e58-4ad8-adee-5971b780447b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-fdb69e03-1e58-4ad8-adee-5971b780447b" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[389aac6f-7c14-4f99-a709-eb4cba67c552]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:42 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b Jun 29 03:03:42 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:43 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b" returned: 0 in 1.134s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:43 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b Jun 29 03:03:43 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:44 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fdb69e03-1e58-4ad8-adee-5971b780447b" returned: 0 in 0.771s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-fdb69e03-1e58-4ad8-adee-5971b780447b" released by "delete_volume" :: held 1.988s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['bbc77364-c14a-45a1-afcf-fbf17f08fd4b'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:44 devstack cinder-volume[93518]: WARNING cinder.quota [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1917369628 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1917369628, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:03:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['ea77ec1d-7fe7-4dd3-95fd-04d4f1c26ed0', '4b7a58ac-d341-4a21-b140-fe5a503d8327', 'cb7739d7-c62b-4417-b752-d889014ac151', '4b47b11b-d9c5-47ab-b6be-195e4d135501'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['53a7ed39-bbd8-4cb4-8436-7dbceb73e036', '4509ca9e-048f-4c5c-9863-11d8f44f0f6f', 'aedcd9db-f9aa-44de-94c6-424e8922b902', 'e458bd05-ee1f-44b0-8245-0b9285b412b2'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:45 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:03:45 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:46 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.195s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:46 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:03:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-878e60a0-1eb4-4e40-9524-fe7fa988b5e6 tempest-GroupSnapshotsTest-1168059695 None] Delete group completed successfully. Jun 29 03:03:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-67135e4f-b182-4cce-bc00-e4e1d66932fb tempest-GroupSnapshotsTest-1168059695 None] Group tempest-GroupSnapshotsTest-Group-2050475797: creating Jun 29 03:03:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-67135e4f-b182-4cce-bc00-e4e1d66932fb tempest-GroupSnapshotsTest-1168059695 None] Group tempest-GroupSnapshotsTest-Group-2050475797: created successfully Jun 29 03:03:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-67135e4f-b182-4cce-bc00-e4e1d66932fb tempest-GroupSnapshotsTest-1168059695 None] Create group completed successfully. Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (62d34f0b-1627-430e-b995-0fe9070d2a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0645d1ef-a6b4-4672-9373-1634836457e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0645d1ef-a6b4-4672-9373-1634836457e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870054012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=391a6829-bdbd-4e3c-9f49-8c324e279c4f,host='devstack@QuobyteHD#QuobyteHD',id=b9259d68-4ede-45b1-b54e-467024aee3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:48Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35680ea1-b4d4-4a1e-8f96-e8704caf0acf),volume_type_id=35680ea1-b4d4-4a1e-8f96-e8704caf0acf)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a61e9d0-7e74-4346-a174-f6ad93a60b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a61e9d0-7e74-4346-a174-f6ad93a60b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3697bd-bcc0-45ac-bebc-2878387457d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3697bd-bcc0-45ac-bebc-2878387457d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9259d68-4ede-45b1-b54e-467024aee3d9', 'volume_name': 'volume-b9259d68-4ede-45b1-b54e-467024aee3d9', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e93f8e-3474-4bea-8cb2-6db57b2a5679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2e93f8e-3474-4bea-8cb2-6db57b2a5679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df253714-b4f2-42cd-b6ef-2d4b95f5eb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:48 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Volume b9259d68-4ede-45b1-b54e-467024aee3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9259d68-4ede-45b1-b54e-467024aee3d9', 'volume_size': 1} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=391a6829-bdbd-4e3c-9f49-8c324e279c4f,created_at=2026-06-29T01:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1870054012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=391a6829-bdbd-4e3c-9f49-8c324e279c4f,host='devstack@QuobyteHD#QuobyteHD',id=b9259d68-4ede-45b1-b54e-467024aee3d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d09a571cda14ac597ba0b54be7f996e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:03:48Z,use_quota=True,user_id='09196ae9bcd84ed48e4b666d45b9574f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35680ea1-b4d4-4a1e-8f96-e8704caf0acf),volume_type_id=35680ea1-b4d4-4a1e-8f96-e8704caf0acf)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Creating volume b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:03:48 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:03:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:48 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 1073741824 Jun 29 03:03:48 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:49 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 1073741824" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:49 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 Jun 29 03:03:49 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:50 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9" returned: 0 in 0.666s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df253714-b4f2-42cd-b6ef-2d4b95f5eb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9259d68-4ede-45b1-b54e-467024aee3d9', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e6e2c0-c87e-4984-9470-7add5c36aff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:03:50 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Volume volume-b9259d68-4ede-45b1-b54e-467024aee3d9 (b9259d68-4ede-45b1-b54e-467024aee3d9): created successfully Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e6e2c0-c87e-4984-9470-7add5c36aff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:03:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Flow 'volume_create_manager' (62d34f0b-1627-430e-b995-0fe9070d2a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:03:50 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e2e59cd8-8fb1-4740-aaf3-6f91f97bfcd9 tempest-GroupSnapshotsTest-1168059695 None] Created volume successfully. Jun 29 03:03:51 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] GroupSnapshot 1a75051b-c292-4fcd-8db2-e0d31980c3e7: creating. Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=97,cinder:UPDATE=87,cinder:INSERT=24,cinder:DELETE=3 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=91,cinder:SELECT=104,cinder:INSERT=14,cinder:DELETE=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Group snapshot 1a75051b-c292-4fcd-8db2-e0d31980c3e7: creating. {{(pid=93518) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Creating offline snapshot d1ed17ee-8cda-46b0-b146-8ddaafab7a84 of volume b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6284ce99-09e4-4808-9795-14df31923c60]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:51 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 Jun 29 03:03:51 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:52 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9" returned: 0 in 1.317s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:52 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 1G Jun 29 03:03:52 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "cinder-75eee245-7054-4272-a0ec-099b8121a9b0-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Lock "cinder-75eee245-7054-4272-a0ec-099b8121a9b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "cinder-quobyte-75eee245-7054-4272-a0ec-099b8121a9b0" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Lock "cinder-quobyte-75eee245-7054-4272-a0ec-099b8121a9b0" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20c425e-320a-44c2-aa76-bd93ea8f2306]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:53 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 Jun 29 03:03:53 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:53 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 1G" returned: 0 in 0.977s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9259d68-4ede-45b1-b54e-467024aee3d9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:53 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9259d68-4ede-45b1-b54e-467024aee3d9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 Jun 29 03:03:53 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:54 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0" returned: 0 in 0.819s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:54 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0 Jun 29 03:03:54 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:54 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9259d68-4ede-45b1-b54e-467024aee3d9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84" returned: 0 in 0.762s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:54 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:03:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:54 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 Jun 29 03:03:54 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:55 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-75eee245-7054-4272-a0ec-099b8121a9b0" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Lock "cinder-quobyte-75eee245-7054-4272-a0ec-099b8121a9b0" released by "delete_volume" :: held 1.690s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Created reservations ['478ed99a-3c32-474b-b367-0f075d9f7ccf', 'b3439286-b4f6-4185-888f-bd20a263a80b', 'c6ef2a5f-8501-4928-a625-60cff01ad06d', 'd38f27b3-fb47-41bc-9aea-6d26b8c05add'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:55 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:03:55 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:55 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84" returned: 0 in 0.770s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:55 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info Jun 29 03:03:55 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:56 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.825s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:03:56 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Deleted volume successfully. Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3a72c8b9-a5cd-45a6-88cd-7e4b5a59f005 tempest-ServerActionsTestOtherA-1266192730 None] Lock "cinder-75eee245-7054-4272-a0ec-099b8121a9b0-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:03:56 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info" returned: 0 in 0.775s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:56 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:56 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info Jun 29 03:03:56 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:56 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.info" returned: 0 in 0.707s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.439s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-365fce66-7589-4700-b03b-ac24b963bae7 tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 1a75051b-c292-4fcd-8db2-e0d31980c3e7: created successfully Jun 29 03:03:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 1a75051b-c292-4fcd-8db2-e0d31980c3e7: deleting Jun 29 03:03:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 1a75051b-c292-4fcd-8db2-e0d31980c3e7: deleting {{(pid=93518) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:03:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-b9259d68-4ede-45b1-b54e-467024aee3d9" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-b9259d68-4ede-45b1-b54e-467024aee3d9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-d1ed17ee-8cda-46b0-b146-8ddaafab7a84" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-d1ed17ee-8cda-46b0-b146-8ddaafab7a84" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Deleting offline snapshot d1ed17ee-8cda-46b0-b146-8ddaafab7a84 of volume b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] snapshot_file for this snap is: volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8592e7ec-3e3d-4233-afd8-b5658f96df20]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee8cc63-55fc-441d-a821-10ef8ff14a79]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:58 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 Jun 29 03:03:58 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:58 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e Jun 29 03:03:58 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:03:59 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84" returned: 0 in 1.057s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9259d68-4ede-45b1-b54e-467024aee3d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c61b47-8cdb-4f43-b5cb-e427f71a7b62]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e" returned: 0 in 1.153s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.173s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:03:59 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Jun 29 03:03:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-b217fc78-b30e-4413-9810-c7024d6da67e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a3a43d0-b7ca-4113-a54e-b37c09e8eeae', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:03:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-714b6b8f-fa6e-4568-bc68-8ede553b4562 req-970dbad7-817c-4329-a5fc-f8e340dc2eef tempest-TaggedAttachmentsTest-1968115717 None] attachment_update completed successfully. Jun 29 03:03:59 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 Jun 29 03:03:59 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:00 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9" returned: 0 in 0.884s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:00 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 Jun 29 03:04:00 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:00 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84" returned: 0 in 0.857s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:00 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84 Jun 29 03:04:00 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:01 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9.d1ed17ee-8cda-46b0-b146-8ddaafab7a84" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-d1ed17ee-8cda-46b0-b146-8ddaafab7a84" released by "_delete_snapshot" :: held 3.798s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-b9259d68-4ede-45b1-b54e-467024aee3d9" released by "delete_snapshot" :: held 3.826s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:01 devstack cinder-volume[93518]: WARNING cinder.quota [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1708437211 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1708437211, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:04:01 devstack cinder-volume[93518]: WARNING cinder.quota [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1708437211 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1708437211, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:04:01 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['50b64d1e-4cbb-432d-a931-2b909f000eb5', '16b6607a-aa36-4ead-9523-d51b58a2747b', '85b3b1e2-f3db-4d67-826a-fb1e03396667', '2865adf3-c018-4c97-b229-32566c5e2aa1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3e850020-52ca-4892-bbc5-3d9bd94500ae tempest-GroupSnapshotsTest-1168059695 None] group_snapshot 1a75051b-c292-4fcd-8db2-e0d31980c3e7: deleted successfully Jun 29 03:04:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "cinder-quobyte-b9259d68-4ede-45b1-b54e-467024aee3d9" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-b9259d68-4ede-45b1-b54e-467024aee3d9" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7dccb9-8d40-4f8c-8ab3-220e82dcdeef]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:03 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 Jun 29 03:04:03 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:03 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9" returned: 0 in 0.830s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:03 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9 Jun 29 03:04:03 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:04 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b9259d68-4ede-45b1-b54e-467024aee3d9" returned: 0 in 0.765s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Lock "cinder-quobyte-b9259d68-4ede-45b1-b54e-467024aee3d9" released by "delete_volume" :: held 1.689s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['78b5f4c4-161d-4190-9809-93c41875eaed'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:04 devstack cinder-volume[93518]: WARNING cinder.quota [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1708437211 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1708437211, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Created reservations ['7bf19c8f-681d-4393-abb9-c5c4a4aa2f50', '2b0b6023-3ffd-4be2-890c-fb56d667dc48', 'f08badba-07a6-462d-8a42-59d9b2f1bde2', '4caa94dc-0ca7-4b64-839c-afa501fcd461'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:04 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:04:04 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:05 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.875s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:05 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:04:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4f4e9346-fa03-4883-86f3-7afbf910d5e0 tempest-GroupSnapshotsTest-1168059695 None] Delete group completed successfully. Jun 29 03:04:06 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-24402c2e-0b9c-4661-8b40-cfa9112752be req-19ffd38e-a9be-4517-a757-e0f665d7d04d tempest-TaggedAttachmentsTest-1968115717 None] Terminate volume connection completed successfully. Jun 29 03:04:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-24402c2e-0b9c-4661-8b40-cfa9112752be req-19ffd38e-a9be-4517-a757-e0f665d7d04d tempest-TaggedAttachmentsTest-1968115717 None] Deleting attachment 0a3a43d0-b7ca-4113-a54e-b37c09e8eeae. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:04:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dd1e1546-a240-4a6d-bdad-97a2b1a1eee1 tempest-GroupsV314Test-115747623 None] Group tempest-GroupsV314Test-Group-1403579986: creating Jun 29 03:04:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dd1e1546-a240-4a6d-bdad-97a2b1a1eee1 tempest-GroupsV314Test-115747623 None] Group tempest-GroupsV314Test-Group-1403579986: created successfully Jun 29 03:04:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dd1e1546-a240-4a6d-bdad-97a2b1a1eee1 tempest-GroupsV314Test-115747623 None] Create group completed successfully. Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Flow 'volume_create_manager' (36e73bfc-7bfc-46fa-8d4d-96b6d6e4f847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed43aba-5313-4aae-8b7b-79345dc80b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed43aba-5313-4aae-8b7b-79345dc80b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858057871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a22297db-a6ae-4829-a631-bd473a7b04d9,host='devstack@QuobyteHD#QuobyteHD',id=2a0a479e-37b2-4c62-920e-afe6dd62bff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492d586da73b41e4a75f68d12294c82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:04:17Z,use_quota=True,user_id='2bdcdbbb4b6945258166d97b2933b42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05f111c2-e67b-40ce-ab44-8b24f15759be),volume_type_id=05f111c2-e67b-40ce-ab44-8b24f15759be)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ffbbc0-3942-47b2-a66c-30a9c8eb4e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62ffbbc0-3942-47b2-a66c-30a9c8eb4e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c038f7c4-2743-47fc-b5e2-34ab4dc94167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c038f7c4-2743-47fc-b5e2-34ab4dc94167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0a479e-37b2-4c62-920e-afe6dd62bff2', 'volume_name': 'volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea52496-935f-4f08-a521-3ec3dca05999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea52496-935f-4f08-a521-3ec3dca05999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402fb109-28d4-4b01-9c58-a5042f55916a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:16 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Volume 2a0a479e-37b2-4c62-920e-afe6dd62bff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2', 'volume_size': 1} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a22297db-a6ae-4829-a631-bd473a7b04d9,created_at=2026-06-29T01:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-858057871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a22297db-a6ae-4829-a631-bd473a7b04d9,host='devstack@QuobyteHD#QuobyteHD',id=2a0a479e-37b2-4c62-920e-afe6dd62bff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492d586da73b41e4a75f68d12294c82c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:04:17Z,use_quota=True,user_id='2bdcdbbb4b6945258166d97b2933b42e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05f111c2-e67b-40ce-ab44-8b24f15759be),volume_type_id=05f111c2-e67b-40ce-ab44-8b24f15759be)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Creating volume 2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:04:17 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:17 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 1073741824 Jun 29 03:04:17 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:17 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:04:17 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:18 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 1073741824" returned: 0 in 1.135s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:18 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:18 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:18 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.891s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 8 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:04:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:04:19 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 0.933s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402fb109-28d4-4b01-9c58-a5042f55916a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381cdfe5-6809-4e53-b9e9-4eb54c4e1ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Volume volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 (2a0a479e-37b2-4c62-920e-afe6dd62bff2): created successfully Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (381cdfe5-6809-4e53-b9e9-4eb54c4e1ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Flow 'volume_create_manager' (36e73bfc-7bfc-46fa-8d4d-96b6d6e4f847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:04:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-37e8f5a0-1333-4b0c-9b8f-66c2295dfcc2 tempest-GroupsV314Test-115747623 None] Created volume successfully. Jun 29 03:04:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:21 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Cloning volume 2a0a479e-37b2-4c62-920e-afe6dd62bff2 to volume 9afb932e-e9cf-4a4f-9cf1-27af79dedb55 Jun 29 03:04:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Creating offline snapshot f53fc12a-95da-4946-ba3a-56c1e88b3b61 of volume 2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:04:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[004cc946-c078-4336-bf7b-a8d10023b8d3]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:22 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:22 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:23 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 1.196s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:23 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 1G Jun 29 03:04:23 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:24 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 1G" returned: 0 in 1.053s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:24 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 Jun 29 03:04:24 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:25 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61" returned: 0 in 0.872s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:25 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:04:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:25 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 Jun 29 03:04:25 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:26 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61" returned: 0 in 0.771s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:26 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info Jun 29 03:04:26 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:26 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info" returned: 0 in 0.800s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:26 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:04:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:26 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info Jun 29 03:04:26 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:27 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.info" returned: 0 in 0.795s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Acquiring lock "cinder-quobyte-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] snapshot: f53fc12a-95da-4946-ba3a-56c1e88b3b61, volume: 9afb932e-e9cf-4a4f-9cf1-27af79dedb55, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1038ca-2501-44df-bb1d-e69a7224987f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:27 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 Jun 29 03:04:27 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:28 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61" returned: 0 in 0.931s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:04:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:04:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:04:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cfc038-acd1-4524-8d65-0cc8183e46ef]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:28 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:28 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:29 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 1.217s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:29 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:04:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:29 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 Jun 29 03:04:29 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Acquiring lock "cinder-b217fc78-b30e-4413-9810-c7024d6da67e-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Lock "cinder-b217fc78-b30e-4413-9810-c7024d6da67e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Acquiring lock "cinder-quobyte-b217fc78-b30e-4413-9810-c7024d6da67e" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Lock "cinder-quobyte-b217fc78-b30e-4413-9810-c7024d6da67e" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a8d12c-dd97-47fb-ae4f-abc07eab4d52]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:30 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e Jun 29 03:04:30 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:31 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e" returned: 0 in 1.253s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:31 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e Jun 29 03:04:31 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:33 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b217fc78-b30e-4413-9810-c7024d6da67e" returned: 0 in 1.563s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Lock "cinder-quobyte-b217fc78-b30e-4413-9810-c7024d6da67e" released by "delete_volume" :: held 2.918s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Created reservations ['d6e37454-6ec4-4407-b418-4357bcbc9d2d', 'b027ced3-e276-402e-ac9a-7ff80455a6a2', '06e4de3a-5eb3-431b-813d-335b1aff71b7', '0484b7fb-bf50-4da1-ab53-b3e334851d22'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:33 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:04:33 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:35 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.920s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:35 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:04:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Deleted volume successfully. Jun 29 03:04:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4efb9808-ad5f-496c-8842-9aba2b969c8f tempest-TaggedAttachmentsTest-1968115717 None] Lock "cinder-b217fc78-b30e-4413-9810-c7024d6da67e-delete_volume" released by "delete_volume" :: held 5.324s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Flow 'volume_create_manager' (b97d7569-9616-45f6-b61f-d9eb766e1e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa258be-6282-4054-8430-ee891e28511f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa258be-6282-4054-8430-ee891e28511f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-146427401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522f2709-13d0-4aab-aec4-6db6bbef321b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1936a5953384069ac064d1fa904b49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:04:38Z,use_quota=True,user_id='8a0f54da24f146f98fa2fcaf5b694ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f321873-1b5e-4357-88ad-2c3998b3e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f321873-1b5e-4357-88ad-2c3998b3e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f58c8-2b53-4e60-9c54-f2737960c29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410f58c8-2b53-4e60-9c54-f2737960c29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522f2709-13d0-4aab-aec4-6db6bbef321b', 'volume_name': 'volume-522f2709-13d0-4aab-aec4-6db6bbef321b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68470846-2457-4522-9b01-97123585ea7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68470846-2457-4522-9b01-97123585ea7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d663788-0034-4832-ab65-c0d5f7d74879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:37 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Volume 522f2709-13d0-4aab-aec4-6db6bbef321b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522f2709-13d0-4aab-aec4-6db6bbef321b', 'volume_size': 1} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:37 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" returned: 0 in 7.893s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c1da36-2891-4913-9091-d5ba6d50d76e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:37 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:37 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:38 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 1.098s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:38 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:04:38 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Converted 1024.00 MB image at 129.73 MB/s Jun 29 03:04:38 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:04:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:38 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 Jun 29 03:04:38 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:39 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" returned: 0 in 0.935s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" released by "_copy_volume_from_snapshot" :: held 12.177s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Acquiring lock "cinder-quobyte-f53fc12a-95da-4946-ba3a-56c1e88b3b61" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-f53fc12a-95da-4946-ba3a-56c1e88b3b61" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Deleting offline snapshot f53fc12a-95da-4946-ba3a-56c1e88b3b61 of volume 2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:04:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] snapshot_file for this snap is: volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:04:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d547bd10-96a0-436a-bd5e-642e9b830321]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:40 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 Jun 29 03:04:40 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:41 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61" returned: 0 in 1.061s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:04:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a585d46-9854-4b23-953f-24d8f447cbf8]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:41 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:41 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:42 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 0.989s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:42 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 Jun 29 03:04:42 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:43 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61" returned: 0 in 0.908s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:43 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61 Jun 29 03:04:43 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:43 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2.f53fc12a-95da-4946-ba3a-56c1e88b3b61" returned: 0 in 0.806s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-f53fc12a-95da-4946-ba3a-56c1e88b3b61" released by "_delete_snapshot" :: held 3.914s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.935s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.069s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-146427401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522f2709-13d0-4aab-aec4-6db6bbef321b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1936a5953384069ac064d1fa904b49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:04:38Z,use_quota=True,user_id='8a0f54da24f146f98fa2fcaf5b694ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Creating volume 522f2709-13d0-4aab-aec4-6db6bbef321b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:04:43 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:04:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:44 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b 1073741824 Jun 29 03:04:44 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:44 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0bd4f793-82de-48a8-b2b8-252ea3cde62a tempest-GroupsV314Test-115747623 None] Create group from source-group-a22297db-a6ae-4829-a631-bd473a7b04d9 completed successfully. Jun 29 03:04:44 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b 1073741824" returned: 0 in 0.992s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:45 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b Jun 29 03:04:45 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Acquiring lock "cinder-quobyte-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" acquired by "delete_volume" :: waited 0.032s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[76711348-3145-40e0-8e18-d8ff75d5b55d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:45 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 Jun 29 03:04:45 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:45 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b" returned: 0 in 0.998s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:04:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d663788-0034-4832-ab65-c0d5f7d74879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522f2709-13d0-4aab-aec4-6db6bbef321b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b04d53-5210-4e83-9a36-1e6a9cc8ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:04:46 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Volume volume-522f2709-13d0-4aab-aec4-6db6bbef321b (522f2709-13d0-4aab-aec4-6db6bbef321b): created successfully Jun 29 03:04:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b04d53-5210-4e83-9a36-1e6a9cc8ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:04:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Flow 'volume_create_manager' (b97d7569-9616-45f6-b61f-d9eb766e1e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:04:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9de87e28-28e4-4548-afd8-4d717005384a tempest-AttachVolumeNegativeTest-2146070891 None] Created volume successfully. Jun 29 03:04:47 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" returned: 0 in 1.317s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:47 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55 Jun 29 03:04:47 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:48 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" returned: 0 in 1.226s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-9afb932e-e9cf-4a4f-9cf1-27af79dedb55" released by "delete_volume" :: held 2.656s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Created reservations ['83ac213f-90a5-48af-90de-67a051a03986'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:48 devstack cinder-volume[93518]: WARNING cinder.quota [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1276178258 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1276178258, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:04:48 devstack cinder-volume[93518]: WARNING cinder.quota [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1276178258 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1276178258, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Created reservations ['091393d5-0421-40f1-ab00-34e6b2925d7b', '90d4460e-fac7-41c8-a5c6-fef32206a080', '581afad6-5a0d-4b21-bed9-3d960509ac2a', '36a6c289-f610-41c6-9ee9-3f2a5b96a97a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:48 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:04:48 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:50 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.397s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:50 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:04:50 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8f5a115d-a384-4a15-9540-fb8b6b2431c1 tempest-GroupsV314Test-115747623 None] Delete group completed successfully. Jun 29 03:04:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Acquiring lock "cinder-quobyte-2a0a479e-37b2-4c62-920e-afe6dd62bff2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:04:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-2a0a479e-37b2-4c62-920e-afe6dd62bff2" acquired by "delete_volume" :: waited 0.073s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:04:50 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[da379ae3-3f2f-4f12-80cd-4344b5bc45df]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:50 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:50 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=62,cinder:UPDATE=57,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=56,cinder:INSERT=18,cinder:UPDATE=59,cinder:DELETE=3 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d00fc-09d1-4419-a0b6-122c573e2b69]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:52 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b Jun 29 03:04:52 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:52 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 2.184s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:52 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2 Jun 29 03:04:52 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:54 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2a0a479e-37b2-4c62-920e-afe6dd62bff2" returned: 0 in 1.361s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:54 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b" returned: 0 in 1.884s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.933s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Lock "cinder-quobyte-2a0a479e-37b2-4c62-920e-afe6dd62bff2" released by "delete_volume" :: held 3.766s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-522f2709-13d0-4aab-aec4-6db6bbef321b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a80fbb19-cba9-40ee-a3fe-1d47bc88f226', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Created reservations ['02ff4d71-8c4d-4d48-bdbc-749eb57c58dd'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Created reservations ['74c2c458-bebd-4dc6-a9eb-92275de5f01c', '70a926e1-173b-486a-9177-de7565958b68', '02a0d1fa-a7a1-4ac6-9c45-11562ed2a0ff', '869e87af-1459-42ff-9fe3-a065e0e8db68'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:04:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-8fcc7487-06cb-4a2e-b8d8-697ca8d80199 req-792b534a-e7b2-4915-bbb8-833c43502f73 tempest-AttachVolumeNegativeTest-2146070891 None] attachment_update completed successfully. Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.057s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:04:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:04:54 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:04:54 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:04:56 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jun 29 03:04:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.416s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:04:56 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:04:56 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8c903a04-255a-4ebe-be7e-ab5c51bee991 tempest-GroupsV314Test-115747623 None] Delete group completed successfully. Jun 29 03:05:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-488744c6-c80e-46e4-b408-8a09ab9192b7 req-ebd0da16-68b6-4cc7-a456-23cb538a8dee tempest-AttachVolumeNegativeTest-2146070891 None] Terminate volume connection completed successfully. Jun 29 03:05:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-488744c6-c80e-46e4-b408-8a09ab9192b7 req-ebd0da16-68b6-4cc7-a456-23cb538a8dee tempest-AttachVolumeNegativeTest-2146070891 None] Deleting attachment a80fbb19-cba9-40ee-a3fe-1d47bc88f226. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:05:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b3b7c086-45e9-4d8d-aacc-ab3fb240a243 tempest-GroupsV320Test-1017676949 None] Group tempest-GroupsV320Test-Group-1492638462: creating Jun 29 03:05:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b3b7c086-45e9-4d8d-aacc-ab3fb240a243 tempest-GroupsV320Test-1017676949 None] Group tempest-GroupsV320Test-Group-1492638462: created successfully Jun 29 03:05:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b3b7c086-45e9-4d8d-aacc-ab3fb240a243 tempest-GroupsV320Test-1017676949 None] Create group completed successfully. Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Created reservations ['9c8d5fb7-6505-4493-b1c5-8c5c01c0f6d2'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:07 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:07 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:08 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.000s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:08 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-07fc3bcc-be2a-410c-98a9-b0aa75db84fd tempest-GroupsV320Test-1017676949 None] Delete group completed successfully. Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Flow 'volume_create_manager' (086135cd-b144-4335-b7bf-e7b550872957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ae9f80-c974-446c-aeed-2fd3a9b65a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ae9f80-c974-446c-aeed-2fd3a9b65a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-342382129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b55b31c-fbe0-4e8d-9d51-5688b79c6922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976f40484e6a48938839e9cef06e6686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:10Z,use_quota=True,user_id='34a797a87f054132ad2a580314bd7ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8840dc-9d35-4a27-b361-300aa8dfc31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8840dc-9d35-4a27-b361-300aa8dfc31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3cd868-1c16-454e-8dc6-cbd27da29236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3cd868-1c16-454e-8dc6-cbd27da29236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b55b31c-fbe0-4e8d-9d51-5688b79c6922', 'volume_name': 'volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2a40f8-bb9d-4c6b-9d89-4410b0f681ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2a40f8-bb9d-4c6b-9d89-4410b0f681ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6bf2f8-8b38-4fa5-b888-45d21d836a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:10 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Volume 1b55b31c-fbe0-4e8d-9d51-5688b79c6922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922', 'volume_size': 1} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-342382129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b55b31c-fbe0-4e8d-9d51-5688b79c6922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='976f40484e6a48938839e9cef06e6686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:10Z,use_quota=True,user_id='34a797a87f054132ad2a580314bd7ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Creating volume 1b55b31c-fbe0-4e8d-9d51-5688b79c6922 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:10 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:10 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 1073741824 Jun 29 03:05:10 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:11 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 1073741824" returned: 0 in 1.253s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:11 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 Jun 29 03:05:11 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:13 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922" returned: 0 in 1.635s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] <== create_volume: return (3000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6bf2f8-8b38-4fa5-b888-45d21d836a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd655b8-446f-4232-bb73-9b8e9ce95644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:13 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Volume volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 (1b55b31c-fbe0-4e8d-9d51-5688b79c6922): created successfully Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd655b8-446f-4232-bb73-9b8e9ce95644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Flow 'volume_create_manager' (086135cd-b144-4335-b7bf-e7b550872957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:13 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4b3cd400-41cc-4aed-810e-fe63a32dc508 tempest-ServerRescueNegativeTestJSON-225744354 None] Created volume successfully. Jun 29 03:05:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "cinder-522f2709-13d0-4aab-aec4-6db6bbef321b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-522f2709-13d0-4aab-aec4-6db6bbef321b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "cinder-quobyte-522f2709-13d0-4aab-aec4-6db6bbef321b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-quobyte-522f2709-13d0-4aab-aec4-6db6bbef321b" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:15 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2612325e-2693-4c0b-9496-35e704adcd18]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:15 devstack sudo[100178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b Jun 29 03:05:15 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:16 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b" returned: 0 in 1.310s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:16 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b Jun 29 03:05:16 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:17 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:17 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:17 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-522f2709-13d0-4aab-aec4-6db6bbef321b" returned: 0 in 1.345s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-quobyte-522f2709-13d0-4aab-aec4-6db6bbef321b" released by "delete_volume" :: held 2.727s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Created reservations ['2db2dcb3-f27e-440f-b9d6-4ef6df07fa93', '0aff176d-ab88-432a-bc80-cc9b9ff63f54', '8ec6635e-b15a-461a-8925-803a9339e9ec', '2ebae93c-8925-4d1a-822d-fa5a26699dc2'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:18 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:18 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:18 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.332s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 8 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "cinder-c55d461f-eff5-4c77-a67a-4c1ec7532d02-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-c55d461f-eff5-4c77-a67a-4c1ec7532d02-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "cinder-quobyte-c55d461f-eff5-4c77-a67a-4c1ec7532d02" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-quobyte-c55d461f-eff5-4c77-a67a-4c1ec7532d02" acquired by "delete_volume" :: waited 0.038s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e803032-24dd-429c-b79c-249f1d6accff]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:19 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 Jun 29 03:05:19 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:20 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 2.136s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:20 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Deleted volume successfully. Jun 29 03:05:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-93b1976a-6c28-4355-a655-2e755428b5a3 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-522f2709-13d0-4aab-aec4-6db6bbef321b-delete_volume" released by "delete_volume" :: held 5.296s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:21 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02" returned: 0 in 1.698s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:21 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02 Jun 29 03:05:21 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:21 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c55d461f-eff5-4c77-a67a-4c1ec7532d02" returned: 0 in 0.822s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-quobyte-c55d461f-eff5-4c77-a67a-4c1ec7532d02" released by "delete_volume" :: held 2.617s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Created reservations ['cc447846-4991-4b10-a7bf-d2e52246d41c', 'b45089e0-05ed-4d11-a0d6-c3b9265f9a65', 'e167ce8b-4e15-4a0f-a842-7b5a0cccba2c', '9db9792c-2edc-4631-8146-38502fb8404b'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:22 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:22 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "cinder-05b8732b-3b7f-474d-8e06-b85103db91b3-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-05b8732b-3b7f-474d-8e06-b85103db91b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "cinder-quobyte-05b8732b-3b7f-474d-8e06-b85103db91b3" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-quobyte-05b8732b-3b7f-474d-8e06-b85103db91b3" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d3414d-7ab4-499d-8161-8e50e8a665de]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:22 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.887s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:22 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:23 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Deleted volume successfully. Jun 29 03:05:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6f5ec50b-d47f-44bf-9482-7b0428d34b69 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-c55d461f-eff5-4c77-a67a-4c1ec7532d02-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:23 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 Jun 29 03:05:23 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:23 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3" returned: 0 in 0.937s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:23 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3 Jun 29 03:05:23 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:24 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-05b8732b-3b7f-474d-8e06-b85103db91b3" returned: 0 in 0.731s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-quobyte-05b8732b-3b7f-474d-8e06-b85103db91b3" released by "delete_volume" :: held 1.734s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Created reservations ['93e34dde-9afe-404b-956c-6934ebc3ebb0', '7e1b5190-27d4-485d-a458-851a245892d8', '1563c10c-4d46-4be7-87af-406ad683ea49', 'f68c3f7e-251c-4406-884a-16f807372b0e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:24 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:24 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:25 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.074s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:25 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:25 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Deleted volume successfully. Jun 29 03:05:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37dbf00-f0b9-433a-a833-7e2857c42fe7 tempest-AttachVolumeNegativeTest-2146070891 None] Lock "cinder-05b8732b-3b7f-474d-8e06-b85103db91b3-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Flow 'volume_create_manager' (364fee67-737e-4219-9010-31c3755524d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5ccc9b-ceb2-490d-bd40-4af94068fc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c5ccc9b-ceb2-490d-bd40-4af94068fc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1314948786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8176bd-66d9-493a-9c14-39182aeca529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114c5e9c1bf04b83834455adbf250149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:27Z,use_quota=True,user_id='d79d4b0a258743478152d85cbce2ea0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0506267c-a25e-45cd-95f3-f1a3712d92cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0506267c-a25e-45cd-95f3-f1a3712d92cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacf1dd4-faf7-4b83-89e4-ae3dbd328ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacf1dd4-faf7-4b83-89e4-ae3dbd328ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8176bd-66d9-493a-9c14-39182aeca529', 'volume_name': 'volume-8d8176bd-66d9-493a-9c14-39182aeca529', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b7c74e-503c-44ba-9068-76f9a9951bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b7c74e-503c-44ba-9068-76f9a9951bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31b404d-a4cd-46c3-8a1b-8057aec7b891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:27 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Volume 8d8176bd-66d9-493a-9c14-39182aeca529: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8176bd-66d9-493a-9c14-39182aeca529', 'volume_size': 1} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1314948786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8176bd-66d9-493a-9c14-39182aeca529,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114c5e9c1bf04b83834455adbf250149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:27Z,use_quota=True,user_id='d79d4b0a258743478152d85cbce2ea0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Creating volume 8d8176bd-66d9-493a-9c14-39182aeca529 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:27 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:27 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 1073741824 Jun 29 03:05:27 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:29 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 1073741824" returned: 0 in 1.273s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:29 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 Jun 29 03:05:29 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:30 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529" returned: 0 in 1.153s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.504s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31b404d-a4cd-46c3-8a1b-8057aec7b891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8176bd-66d9-493a-9c14-39182aeca529', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964df363-887f-4543-aa1d-36c5e7a282ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:30 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Volume volume-8d8176bd-66d9-493a-9c14-39182aeca529 (8d8176bd-66d9-493a-9c14-39182aeca529): created successfully Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964df363-887f-4543-aa1d-36c5e7a282ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Flow 'volume_create_manager' (364fee67-737e-4219-9010-31c3755524d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:30 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a184d536-1da4-4cf0-9eb7-c13ccb52f88c tempest-VolumeQuotasAdminTestJSON-1445697553 None] Created volume successfully. Jun 29 03:05:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "cinder-8d8176bd-66d9-493a-9c14-39182aeca529-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "cinder-8d8176bd-66d9-493a-9c14-39182aeca529-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "cinder-quobyte-8d8176bd-66d9-493a-9c14-39182aeca529" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "cinder-quobyte-8d8176bd-66d9-493a-9c14-39182aeca529" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee91c1b-b302-4a5e-956a-07a9d6c3b117]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:31 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 Jun 29 03:05:31 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:32 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529" returned: 0 in 1.722s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:32 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529 Jun 29 03:05:32 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:34 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d8176bd-66d9-493a-9c14-39182aeca529" returned: 0 in 1.271s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "cinder-quobyte-8d8176bd-66d9-493a-9c14-39182aeca529" released by "delete_volume" :: held 3.049s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Created reservations ['0151156e-d01b-4500-9a94-ab224cbec2ee', 'bff958b1-a863-4b2f-b3be-17c43654f1e7', 'a3c379af-ea7e-4bc5-a3ea-ee0b06cd238b', '822ac6b3-ce3f-424c-87a6-0fb410af23a3'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:34 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:34 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Flow 'volume_create_manager' (5e1331c8-03e1-4be7-8c97-b28f2f024d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0d928d-3c64-4ec6-a4da-b2b822b73ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0d928d-3c64-4ec6-a4da-b2b822b73ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-293209152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c29af12-7cce-41c6-a935-1307e25553f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114c5e9c1bf04b83834455adbf250149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:36Z,use_quota=True,user_id='d79d4b0a258743478152d85cbce2ea0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4804a34-06da-48de-8564-f1b8ab84818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4804a34-06da-48de-8564-f1b8ab84818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7741036c-b600-4679-88b0-953b6ce980f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7741036c-b600-4679-88b0-953b6ce980f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c29af12-7cce-41c6-a935-1307e25553f1', 'volume_name': 'volume-1c29af12-7cce-41c6-a935-1307e25553f1', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e660ba9-b9a9-4666-828c-134319ed953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e660ba9-b9a9-4666-828c-134319ed953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf54003-d69f-4f48-a80b-d7969487e9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:35 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Volume 1c29af12-7cce-41c6-a935-1307e25553f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c29af12-7cce-41c6-a935-1307e25553f1', 'volume_size': 1} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-293209152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c29af12-7cce-41c6-a935-1307e25553f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114c5e9c1bf04b83834455adbf250149',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:36Z,use_quota=True,user_id='d79d4b0a258743478152d85cbce2ea0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Creating volume 1c29af12-7cce-41c6-a935-1307e25553f1 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:35 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:35 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 1073741824 Jun 29 03:05:35 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:35 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.397s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Deleted volume successfully. Jun 29 03:05:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-933f4622-276d-42b2-8fa0-b78db001bb62 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "cinder-8d8176bd-66d9-493a-9c14-39182aeca529-delete_volume" released by "delete_volume" :: held 4.856s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:36 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 1073741824" returned: 0 in 1.161s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:37 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 Jun 29 03:05:37 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:38 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1" returned: 0 in 1.075s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf54003-d69f-4f48-a80b-d7969487e9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c29af12-7cce-41c6-a935-1307e25553f1', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb7d13-1f55-46ea-8990-0c00a42f5e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:38 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Volume volume-1c29af12-7cce-41c6-a935-1307e25553f1 (1c29af12-7cce-41c6-a935-1307e25553f1): created successfully Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcb7d13-1f55-46ea-8990-0c00a42f5e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Flow 'volume_create_manager' (5e1331c8-03e1-4be7-8c97-b28f2f024d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c7cf3943-c090-4517-942f-51e93f5cf861 tempest-VolumeQuotasAdminTestJSON-1445697553 None] Created volume successfully. Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Flow 'volume_create_manager' (6eee3747-92e4-4b3e-b58e-2c70a50e66a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e6fa67-6371-49c4-9fd9-da5e06c6a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25e6fa67-6371-49c4-9fd9-da5e06c6a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1838456290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b9b847-cf7c-422c-b3f1-6923ffad7e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50df8124889f472bb0de47155da8ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:39Z,use_quota=True,user_id='be9314945db149938988999c972c9d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd089de-f021-4a9a-b2a2-2b49484f14f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd089de-f021-4a9a-b2a2-2b49484f14f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70264ec2-3ec4-4301-ac1e-f4b705dd8f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70264ec2-3ec4-4301-ac1e-f4b705dd8f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b9b847-cf7c-422c-b3f1-6923ffad7e70', 'volume_name': 'volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbe7e80-f26c-49b3-8126-f6ed85d73ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbe7e80-f26c-49b3-8126-f6ed85d73ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d27d9e7-533f-4337-a5a1-d7aa8003c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:39 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Volume e3b9b847-cf7c-422c-b3f1-6923ffad7e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70', 'volume_size': 1} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1838456290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b9b847-cf7c-422c-b3f1-6923ffad7e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50df8124889f472bb0de47155da8ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:39Z,use_quota=True,user_id='be9314945db149938988999c972c9d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Creating volume e3b9b847-cf7c-422c-b3f1-6923ffad7e70 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:39 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:39 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 1073741824 Jun 29 03:05:39 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Acquiring lock "cinder-1b55b31c-fbe0-4e8d-9d51-5688b79c6922-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "cinder-1b55b31c-fbe0-4e8d-9d51-5688b79c6922-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Acquiring lock "cinder-quobyte-1b55b31c-fbe0-4e8d-9d51-5688b79c6922" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "cinder-quobyte-1b55b31c-fbe0-4e8d-9d51-5688b79c6922" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6042f6c7-4815-4c1a-b64a-1aeeae0331d6]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f75fed48-bf40-4f6b-a3af-ff2ebdd02a9e tempest-VolumeQuotasAdminTestJSON-1982773234 None] Transfer volume completed successfully. Jun 29 03:05:40 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 Jun 29 03:05:40 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:41 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 1073741824" returned: 0 in 1.482s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:41 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 Jun 29 03:05:41 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:41 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922" returned: 0 in 1.357s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:41 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922 Jun 29 03:05:41 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Acquiring lock "cinder-1c29af12-7cce-41c6-a935-1307e25553f1-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Lock "cinder-1c29af12-7cce-41c6-a935-1307e25553f1-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Acquiring lock "cinder-quobyte-1c29af12-7cce-41c6-a935-1307e25553f1" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Lock "cinder-quobyte-1c29af12-7cce-41c6-a935-1307e25553f1" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d9dd0f-ec8d-439c-b32e-dd30744252a5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:42 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 Jun 29 03:05:42 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:42 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70" returned: 0 in 1.222s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] <== create_volume: return (2778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.781s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d27d9e7-533f-4337-a5a1-d7aa8003c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea11f37-099b-45c8-b576-abf5948361dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Volume volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 (e3b9b847-cf7c-422c-b3f1-6923ffad7e70): created successfully Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aea11f37-099b-45c8-b576-abf5948361dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Flow 'volume_create_manager' (6eee3747-92e4-4b3e-b58e-2c70a50e66a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c4c1fb1a-4e05-4e0f-8e82-87a527c90492 tempest-VolumesListAdminTestJSON-671841308 None] Created volume successfully. Jun 29 03:05:42 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b55b31c-fbe0-4e8d-9d51-5688b79c6922" returned: 0 in 1.145s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "cinder-quobyte-1b55b31c-fbe0-4e8d-9d51-5688b79c6922" released by "delete_volume" :: held 2.584s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Created reservations ['4e796438-9a33-4814-9ff3-ce55a3c3e45e', 'ebeba99b-79a8-4bcd-91ea-25e5b185353d', '4a0c5b25-d277-4afd-bacf-b618af0643c0', 'be44945b-920c-4ca7-a790-d5f245fa1859'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:42 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:42 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:43 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1" returned: 0 in 1.284s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:43 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1 Jun 29 03:05:43 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Flow 'volume_create_manager' (30a396e0-8e50-4f09-b5fa-69f62ad9747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792a1c57-6dca-47da-95ac-ea357e86e421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792a1c57-6dca-47da-95ac-ea357e86e421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1520986677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05671b0-d86d-495a-862c-e1728a10e928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50df8124889f472bb0de47155da8ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:43Z,use_quota=True,user_id='be9314945db149938988999c972c9d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944a914f-aee9-4b5e-917b-2b26a3360347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944a914f-aee9-4b5e-917b-2b26a3360347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5640441-79ae-44ef-9df0-a8f815347345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5640441-79ae-44ef-9df0-a8f815347345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05671b0-d86d-495a-862c-e1728a10e928', 'volume_name': 'volume-e05671b0-d86d-495a-862c-e1728a10e928', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d769d592-bace-43f8-8695-1043e4def6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d769d592-bace-43f8-8695-1043e4def6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e04caa-b364-4de2-8550-196bfb1103f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:43 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Volume e05671b0-d86d-495a-862c-e1728a10e928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05671b0-d86d-495a-862c-e1728a10e928', 'volume_size': 1} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1520986677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05671b0-d86d-495a-862c-e1728a10e928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50df8124889f472bb0de47155da8ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:43Z,use_quota=True,user_id='be9314945db149938988999c972c9d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Creating volume e05671b0-d86d-495a-862c-e1728a10e928 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:43 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:43 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 1073741824 Jun 29 03:05:43 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:44 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1c29af12-7cce-41c6-a935-1307e25553f1" returned: 0 in 1.262s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Lock "cinder-quobyte-1c29af12-7cce-41c6-a935-1307e25553f1" released by "delete_volume" :: held 2.630s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:44 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.648s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:44 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Deleted volume successfully. Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c4572dbf-f350-4bd5-b76f-5aa7abd241e8 tempest-ServerRescueNegativeTestJSON-225744354 None] Lock "cinder-1b55b31c-fbe0-4e8d-9d51-5688b79c6922-delete_volume" released by "delete_volume" :: held 4.638s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Created reservations ['c7422e99-cf6c-43f4-9e89-4997020c5b19', 'acae9120-951f-40e0-91c2-c7bb871a635f', '163d8216-3bb2-4711-bd98-388b90f6f688', 'e897b7c4-6df4-4c86-aa53-2850adaa36cb'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:44 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:44 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:45 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 1073741824" returned: 0 in 1.780s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:45 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 Jun 29 03:05:45 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:46 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.614s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:46 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Deleted volume successfully. Jun 29 03:05:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fe94dcf-e346-472b-bad6-664bbe05a76c tempest-VolumeQuotasAdminTestJSON-1446443406 None] Lock "cinder-1c29af12-7cce-41c6-a935-1307e25553f1-delete_volume" released by "delete_volume" :: held 4.673s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:46 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928" returned: 0 in 1.533s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] <== create_volume: return (3404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.414s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e04caa-b364-4de2-8550-196bfb1103f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05671b0-d86d-495a-862c-e1728a10e928', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799bd426-370c-488a-8ce2-dda8a9430e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:47 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Volume volume-e05671b0-d86d-495a-862c-e1728a10e928 (e05671b0-d86d-495a-862c-e1728a10e928): created successfully Jun 29 03:05:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799bd426-370c-488a-8ce2-dda8a9430e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Flow 'volume_create_manager' (30a396e0-8e50-4f09-b5fa-69f62ad9747e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7c5f3489-aa5e-4f0b-bfb7-66ee5f1c4526 tempest-VolumesListAdminTestJSON-671841308 None] Created volume successfully. Jun 29 03:05:48 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d33f2ac2-27a2-4f06-bae4-4474c78c002b tempest-GroupSnapshotsV319Test-52148997 None] Group tempest-GroupSnapshotsV319Test-Group-402096558: creating Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Flow 'volume_create_manager' (3e7423ed-cfa1-4b04-a17a-79ac291f3385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8276064-7080-4d86-810a-5c45e61ba57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d33f2ac2-27a2-4f06-bae4-4474c78c002b tempest-GroupSnapshotsV319Test-52148997 None] Group tempest-GroupSnapshotsV319Test-Group-402096558: created successfully Jun 29 03:05:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d33f2ac2-27a2-4f06-bae4-4474c78c002b tempest-GroupSnapshotsV319Test-52148997 None] Create group completed successfully. Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8276064-7080-4d86-810a-5c45e61ba57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1285978444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38eb050-cb90-4a45-b058-7d81f3bdc20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50df8124889f472bb0de47155da8ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:49Z,use_quota=True,user_id='be9314945db149938988999c972c9d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d707d48-ce7a-4306-8bb2-0c90d6feebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d707d48-ce7a-4306-8bb2-0c90d6feebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bab6e3e-8577-4d1f-96da-bb069d004fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bab6e3e-8577-4d1f-96da-bb069d004fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38eb050-cb90-4a45-b058-7d81f3bdc20c', 'volume_name': 'volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19187e29-d7bf-40a4-9e1e-f3b2c69ee9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19187e29-d7bf-40a4-9e1e-f3b2c69ee9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5675c8-d231-4569-be17-71a775e98e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Volume d38eb050-cb90-4a45-b058-7d81f3bdc20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c', 'volume_size': 1} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1285978444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38eb050-cb90-4a45-b058-7d81f3bdc20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50df8124889f472bb0de47155da8ba83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:49Z,use_quota=True,user_id='be9314945db149938988999c972c9d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Creating volume d38eb050-cb90-4a45-b058-7d81f3bdc20c {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:49 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:49 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c 1073741824 Jun 29 03:05:49 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:50 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c 1073741824" returned: 0 in 1.217s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:50 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c Jun 29 03:05:50 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:50 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Flow 'volume_create_manager' (a505ef90-fe0e-436b-9f57-1e8b7ce7d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56267b34-5643-44d0-b66f-2f7c2b009dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56267b34-5643-44d0-b66f-2f7c2b009dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4539207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0aadefd0-fd92-439d-8112-0373ee2dae84,host='devstack@QuobyteHD#QuobyteHD',id=118d4aaf-27d0-4cf9-94e8-1bca9c680225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c813fc3bfb3641e9ab9f030cfb0a4e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:51Z,use_quota=True,user_id='edc0f925f0954b3bbbecfa8b319b281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49ae4529-57f6-4ba3-880f-33d20bdc01e3),volume_type_id=49ae4529-57f6-4ba3-880f-33d20bdc01e3)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae4ce4b-56e9-44c2-b371-2d2d2c58cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ae4ce4b-56e9-44c2-b371-2d2d2c58cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef18a4e-371b-4e49-b8e4-3822c9648ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef18a4e-371b-4e49-b8e4-3822c9648ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '118d4aaf-27d0-4cf9-94e8-1bca9c680225', 'volume_name': 'volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f1573e-5e61-452d-8b49-869016bfa4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f1573e-5e61-452d-8b49-869016bfa4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5928656-b754-4979-94b8-9a1ca5e26747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Volume 118d4aaf-27d0-4cf9-94e8-1bca9c680225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225', 'volume_size': 1} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:51 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c" returned: 0 in 1.087s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] <== create_volume: return (2383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.478s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0aadefd0-fd92-439d-8112-0373ee2dae84,created_at=2026-06-29T01:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-4539207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0aadefd0-fd92-439d-8112-0373ee2dae84,host='devstack@QuobyteHD#QuobyteHD',id=118d4aaf-27d0-4cf9-94e8-1bca9c680225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c813fc3bfb3641e9ab9f030cfb0a4e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:51Z,use_quota=True,user_id='edc0f925f0954b3bbbecfa8b319b281f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49ae4529-57f6-4ba3-880f-33d20bdc01e3),volume_type_id=49ae4529-57f6-4ba3-880f-33d20bdc01e3)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Creating volume 118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:51 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5675c8-d231-4569-be17-71a775e98e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1d54e4-bdd8-44fe-bc64-1b67ffd61e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:51 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 1073741824 Jun 29 03:05:51 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Volume volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c (d38eb050-cb90-4a45-b058-7d81f3bdc20c): created successfully Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1d54e4-bdd8-44fe-bc64-1b67ffd61e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Flow 'volume_create_manager' (3e7423ed-cfa1-4b04-a17a-79ac291f3385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:51 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f9aad1c5-2270-44c1-a7cb-214f63f35c17 tempest-VolumesListAdminTestJSON-671841308 None] Created volume successfully. Jun 29 03:05:52 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 1073741824" returned: 0 in 1.180s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:52 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=61,cinder:UPDATE=81,cinder:INSERT=25,cinder:DELETE=3 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:05:52 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=70,cinder:UPDATE=87,cinder:INSERT=11,cinder:DELETE=9 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:05:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:52 devstack sudo[100645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 Jun 29 03:05:52 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Flow 'volume_create_manager' (7ed8fccf-83d6-4ce3-b9cd-1493a5f2e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8920ff-faca-4cb2-9185-7b8f23202671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8920ff-faca-4cb2-9185-7b8f23202671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86e6dc0-9ecc-4929-b649-dc72c1a921a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891ec25e1b1e4195ade506ee887ac154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:54Z,use_quota=True,user_id='120fbbbb01b44b4a81e6d7bf4d9f0418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f30d0-5974-4ed5-aa37-64580f2f65b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775f30d0-5974-4ed5-aa37-64580f2f65b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81926cc-14ce-4230-baa1-533a9348c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c81926cc-14ce-4230-baa1-533a9348c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86e6dc0-9ecc-4929-b649-dc72c1a921a2', 'volume_name': 'volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5b3908-8cd9-4efd-9a58-400971cfa023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e5b3908-8cd9-4efd-9a58-400971cfa023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c20bc8-4aeb-44b2-aa47-26a10d34818b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Volume b86e6dc0-9ecc-4929-b649-dc72c1a921a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2', 'volume_size': 1} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:53 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225" returned: 0 in 1.012s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.122s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86e6dc0-9ecc-4929-b649-dc72c1a921a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891ec25e1b1e4195ade506ee887ac154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:54Z,use_quota=True,user_id='120fbbbb01b44b4a81e6d7bf4d9f0418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Creating volume b86e6dc0-9ecc-4929-b649-dc72c1a921a2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:05:53 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5928656-b754-4979-94b8-9a1ca5e26747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:53 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 1073741824 Jun 29 03:05:53 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891a4b53-e22d-4706-a0b0-c1b58ceff2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Volume volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 (118d4aaf-27d0-4cf9-94e8-1bca9c680225): created successfully Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891a4b53-e22d-4706-a0b0-c1b58ceff2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Flow 'volume_create_manager' (a505ef90-fe0e-436b-9f57-1e8b7ce7d6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5997a65c-d173-46cf-a132-f99651db4e2e tempest-GroupSnapshotsV319Test-52148997 None] Created volume successfully. Jun 29 03:05:54 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 1073741824" returned: 0 in 1.018s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:55 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 Jun 29 03:05:55 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] GroupSnapshot 985931ac-3626-49a4-b67f-4e41cc6d4884: creating. Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Group snapshot 985931ac-3626-49a4-b67f-4e41cc6d4884: creating. {{(pid=93518) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:55 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2" returned: 0 in 0.800s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.497s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c20bc8-4aeb-44b2-aa47-26a10d34818b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ad5288-a869-46b4-934f-dfcdf181b6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Creating offline snapshot 0f80e83b-dfc1-438e-b00f-55ed64f93f51 of volume 118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:05:55 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Volume volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 (b86e6dc0-9ecc-4929-b649-dc72c1a921a2): created successfully Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ad5288-a869-46b4-934f-dfcdf181b6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Flow 'volume_create_manager' (7ed8fccf-83d6-4ce3-b9cd-1493a5f2e37a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7101b-ee6d-4c39-a00f-5fc74f9074ac]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3172400c-9fe2-4803-9c2c-bdd4289e3665 tempest-VolumesListAdminTestJSON-2134697461 None] Created volume successfully. Jun 29 03:05:55 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 Jun 29 03:05:55 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Flow 'volume_create_manager' (0ba14562-bbbe-44cf-8f1c-12fe264cc6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b23ed36-3794-41da-885f-2c6366e1c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b23ed36-3794-41da-885f-2c6366e1c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-355415667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a55bf0-9c00-422c-b777-f9a032b0c3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5242a15329843e8ba04ec2ce609cdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:56Z,use_quota=True,user_id='cff8db65fc4c4fdf87f25e3a9d8ad041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534e1b78-5aa2-420c-bde0-9294accff9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534e1b78-5aa2-420c-bde0-9294accff9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e71d5-c769-4db4-b0e1-1547d786a2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e71d5-c769-4db4-b0e1-1547d786a2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a55bf0-9c00-422c-b777-f9a032b0c3ce', 'volume_name': 'volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed97eb3a-195e-4e2a-8191-b52054a2d67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed97eb3a-195e-4e2a-8191-b52054a2d67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e2da4-d398-4240-8cc7-f2fe9fdf7cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:05:56 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Volume 67a55bf0-9c00-422c-b777-f9a032b0c3ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce', 'volume_size': 1} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:56 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225" returned: 0 in 0.865s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:56 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 1G Jun 29 03:05:56 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Acquiring lock "cinder-b86e6dc0-9ecc-4929-b649-dc72c1a921a2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Lock "cinder-b86e6dc0-9ecc-4929-b649-dc72c1a921a2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Acquiring lock "cinder-quobyte-b86e6dc0-9ecc-4929-b649-dc72c1a921a2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Lock "cinder-quobyte-b86e6dc0-9ecc-4929-b649-dc72c1a921a2" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7d87f8-1850-43e2-9289-eafaa152a406]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "cinder-d38eb050-cb90-4a45-b058-7d81f3bdc20c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-d38eb050-cb90-4a45-b058-7d81f3bdc20c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "cinder-quobyte-d38eb050-cb90-4a45-b058-7d81f3bdc20c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-quobyte-d38eb050-cb90-4a45-b058-7d81f3bdc20c" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[91175c98-ce95-4eaf-aef1-eab74e7a2003]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:57 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 Jun 29 03:05:57 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:57 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c Jun 29 03:05:57 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:57 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 1G" returned: 0 in 0.918s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:57 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 Jun 29 03:05:57 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:57 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2" returned: 0 in 0.875s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:57 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2 Jun 29 03:05:57 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:57 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c" returned: 0 in 0.866s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:58 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c Jun 29 03:05:58 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:58 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51" returned: 0 in 0.858s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:58 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:58 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 Jun 29 03:05:58 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:58 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b86e6dc0-9ecc-4929-b649-dc72c1a921a2" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Lock "cinder-quobyte-b86e6dc0-9ecc-4929-b649-dc72c1a921a2" released by "delete_volume" :: held 1.689s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Created reservations ['1f98c7a4-57b9-45d7-9c08-93b5e11bef97', '2234abbe-a0d2-4383-a67e-e224409240e1', '8320edd8-16a1-4bd4-bd44-1f45d8de7725', 'cc47271e-fb5e-42fb-a775-814f6fd3733c'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:58 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d38eb050-cb90-4a45-b058-7d81f3bdc20c" returned: 0 in 0.753s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-quobyte-d38eb050-cb90-4a45-b058-7d81f3bdc20c" released by "delete_volume" :: held 1.670s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:58 devstack sudo[100713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:58 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Created reservations ['37fcd9ee-eab1-400c-b2a7-c33ccf533148', '67037633-74f6-4031-be62-17a64e3ff718', 'fd9e8216-a0b3-4dcd-be55-7c61441426d4', '7b0c41d3-e11c-4b40-9e47-775605b8dd28'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:05:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:59 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:05:59 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:59 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51" returned: 0 in 0.782s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:59 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info Jun 29 03:05:59 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "cinder-e05671b0-d86d-495a-862c-e1728a10e928-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-e05671b0-d86d-495a-862c-e1728a10e928-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "cinder-quobyte-e05671b0-d86d-495a-862c-e1728a10e928" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-quobyte-e05671b0-d86d-495a-862c-e1728a10e928" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adda419-454b-43d2-b77c-7fb9415fa3ee]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:05:59 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 Jun 29 03:05:59 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:05:59 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.094s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:05:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Deleted volume successfully. Jun 29 03:05:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5350b73b-3d3d-40f6-8bfd-fa9c3fd9781a tempest-VolumesListAdminTestJSON-2134697461 None] Lock "cinder-b86e6dc0-9ecc-4929-b649-dc72c1a921a2-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:00 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.045s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Deleted volume successfully. Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-53708a07-a06d-486d-882a-8fee81d9653c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-d38eb050-cb90-4a45-b058-7d81f3bdc20c-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:00 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info" returned: 0 in 0.917s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:00 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info is being set with open permissions: ugo+rw: NotImplementedError Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:00 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info Jun 29 03:06:00 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:00 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928" returned: 0 in 0.961s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:00 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928 Jun 29 03:06:00 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:01 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.info" returned: 0 in 0.794s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.262s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.516s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-355415667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a55bf0-9c00-422c-b777-f9a032b0c3ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5242a15329843e8ba04ec2ce609cdc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:05:56Z,use_quota=True,user_id='cff8db65fc4c4fdf87f25e3a9d8ad041',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Creating volume 67a55bf0-9c00-422c-b777-f9a032b0c3ce {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:01 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:01 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce 1073741824 Jun 29 03:06:01 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c3ff9198-3149-4c4f-88e7-957467c2a799 tempest-GroupSnapshotsV319Test-52148997 None] group_snapshot 985931ac-3626-49a4-b67f-4e41cc6d4884: created successfully Jun 29 03:06:01 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e05671b0-d86d-495a-862c-e1728a10e928" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-quobyte-e05671b0-d86d-495a-862c-e1728a10e928" released by "delete_volume" :: held 1.811s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Created reservations ['41db624f-518b-46c9-9e11-922dd6f92af4', '012094b7-9c57-4149-b230-da5415d03b52', 'd4b48929-3750-4937-8f4c-7d2a15a957da', '275e16ba-1713-4aa3-96f4-3340a23ae725'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:01 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:01 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "cinder-e3b9b847-cf7c-422c-b3f1-6923ffad7e70-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-e3b9b847-cf7c-422c-b3f1-6923ffad7e70-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "cinder-quobyte-e3b9b847-cf7c-422c-b3f1-6923ffad7e70" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-quobyte-e3b9b847-cf7c-422c-b3f1-6923ffad7e70" acquired by "delete_volume" :: waited 0.046s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd84bda-2b3d-4935-962a-2fe1326c4ad0]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] group_snapshot 985931ac-3626-49a4-b67f-4e41cc6d4884: deleting Jun 29 03:06:02 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce 1073741824" returned: 0 in 1.228s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] group_snapshot 985931ac-3626-49a4-b67f-4e41cc6d4884: deleting {{(pid=93518) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:02 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 Jun 29 03:06:02 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "cinder-quobyte-118d4aaf-27d0-4cf9-94e8-1bca9c680225" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:02 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce Jun 29 03:06:02 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Lock "cinder-quobyte-118d4aaf-27d0-4cf9-94e8-1bca9c680225" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "cinder-quobyte-0f80e83b-dfc1-438e-b00f-55ed64f93f51" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Lock "cinder-quobyte-0f80e83b-dfc1-438e-b00f-55ed64f93f51" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Deleting offline snapshot 0f80e83b-dfc1-438e-b00f-55ed64f93f51 of volume 118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] snapshot_file for this snap is: volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[79259aa4-0423-4fb5-b129-93a88590f659]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:02 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 Jun 29 03:06:02 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:02 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.200s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Deleted volume successfully. Jun 29 03:06:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dc78f1b3-82f6-435e-a25f-d1a7b8ddb82c tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-e05671b0-d86d-495a-862c-e1728a10e928-delete_volume" released by "delete_volume" :: held 3.476s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:03 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:03 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce" returned: 0 in 1.095s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70" returned: 0 in 1.293s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:03 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70 Jun 29 03:06:03 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a0e2da4-d398-4240-8cc7-f2fe9fdf7cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1b9804-5af5-4ebf-b267-c39de073024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:03 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Volume volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce (67a55bf0-9c00-422c-b777-f9a032b0c3ce): created successfully Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f1b9804-5af5-4ebf-b267-c39de073024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Flow 'volume_create_manager' (0ba14562-bbbe-44cf-8f1c-12fe264cc6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cf305798-7c4c-4ac1-8104-1d7f430a3a87 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Created volume successfully. Jun 29 03:06:03 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51" returned: 0 in 1.143s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4e099-fdb5-45e8-86ec-edf870672b00]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:03 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 Jun 29 03:06:03 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:04 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3b9b847-cf7c-422c-b3f1-6923ffad7e70" returned: 0 in 0.791s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-quobyte-e3b9b847-cf7c-422c-b3f1-6923ffad7e70" released by "delete_volume" :: held 2.170s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Created reservations ['d01a5bf9-ec65-4957-b0ab-6b1913e8dab6', 'a8bec88e-ffdb-49be-9fb9-8a1030bd286e', '801585a1-b3d9-4777-92d3-8241d3c67f8f', 'e41e6416-8be3-4b5e-b127-262c23500b0d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:04 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:04 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:04 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225" returned: 0 in 0.917s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:04 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 Jun 29 03:06:04 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Acquiring lock "cinder-67a55bf0-9c00-422c-b777-f9a032b0c3ce-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "cinder-67a55bf0-9c00-422c-b777-f9a032b0c3ce-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:05 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.927s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Deleted volume successfully. Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-73ae784a-8d9a-4167-a442-5746b560f477 tempest-VolumesListAdminTestJSON-671841308 None] Lock "cinder-e3b9b847-cf7c-422c-b3f1-6923ffad7e70-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Acquiring lock "cinder-quobyte-67a55bf0-9c00-422c-b777-f9a032b0c3ce" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "cinder-quobyte-67a55bf0-9c00-422c-b777-f9a032b0c3ce" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea74b9f-3ef1-4fa0-8f9d-c7dc3460dcdf]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:05 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce Jun 29 03:06:05 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:05 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51" returned: 0 in 1.022s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:05 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51 Jun 29 03:06:05 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:06 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce" returned: 0 in 0.886s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:06 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce Jun 29 03:06:06 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:06 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225.0f80e83b-dfc1-438e-b00f-55ed64f93f51" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Lock "cinder-quobyte-0f80e83b-dfc1-438e-b00f-55ed64f93f51" released by "_delete_snapshot" :: held 4.080s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Lock "cinder-quobyte-118d4aaf-27d0-4cf9-94e8-1bca9c680225" released by "delete_snapshot" :: held 4.122s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:06 devstack cinder-volume[93518]: WARNING cinder.quota [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-721501311 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-721501311, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:06 devstack cinder-volume[93518]: WARNING cinder.quota [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-721501311 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-721501311, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:06 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] Created reservations ['f27b9354-09eb-4d2e-8003-dac94fca75d9', 'e784d8e0-f847-46a5-80fd-5382ee4c44c9', 'a636f3e9-f905-44ad-ae2f-3ff4f359299a', 'a8909ec7-bedf-403a-bf8f-e9c1e382921b'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:06 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e37a15f6-fe6c-4caa-97a4-9c978e008517 tempest-GroupSnapshotsV319Test-52148997 None] group_snapshot 985931ac-3626-49a4-b67f-4e41cc6d4884: deleted successfully Jun 29 03:06:07 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-67a55bf0-9c00-422c-b777-f9a032b0c3ce" returned: 0 in 0.918s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "cinder-quobyte-67a55bf0-9c00-422c-b777-f9a032b0c3ce" released by "delete_volume" :: held 1.871s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Created reservations ['bc47e006-7e65-41f9-a2ef-72d13a3f8499', 'fee228fb-35cf-4a6a-b361-e422ab654602', 'c20d3b5a-2718-4254-bc56-b980ff8eac0f', 'a2a4abdf-b957-491b-953e-e87cbc555512'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "cinder-quobyte-118d4aaf-27d0-4cf9-94e8-1bca9c680225" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Lock "cinder-quobyte-118d4aaf-27d0-4cf9-94e8-1bca9c680225" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[639ff7a1-59ed-4e5c-9bf6-b9335211ae7e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:07 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:07 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:07 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 Jun 29 03:06:07 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:08 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225" returned: 0 in 1.029s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:08 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225 Jun 29 03:06:08 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:08 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.244s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:08 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Deleted volume successfully. Jun 29 03:06:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4192fefa-5fb0-4233-a021-37b39f014395 tempest-VolumeQuotasNegativeTestJSON-307349018 None] Lock "cinder-67a55bf0-9c00-422c-b777-f9a032b0c3ce-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:09 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-118d4aaf-27d0-4cf9-94e8-1bca9c680225" returned: 0 in 1.087s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Lock "cinder-quobyte-118d4aaf-27d0-4cf9-94e8-1bca9c680225" released by "delete_volume" :: held 2.237s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:09 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Created reservations ['ff36eebc-356c-482f-aad1-53b78e35cefb'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:09 devstack cinder-volume[93518]: WARNING cinder.quota [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-721501311 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-721501311, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:09 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Created reservations ['00a3e38b-2092-4f81-b213-b0edeefac5f9', '828374d5-99bb-41b0-a999-e2469d409472', '01206fa5-2b8a-483a-b064-e44970c33e83', '7bc9d5c7-717b-4dab-9fbf-8c04b2053a57'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:10 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:10 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:11 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.974s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:11 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:11 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-edfc99f7-fc47-4eee-825f-91dd39907ebc tempest-GroupSnapshotsV319Test-52148997 None] Delete group completed successfully. Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Flow 'volume_create_manager' (d12f002c-7c3b-4ae0-b06a-02b5c95856db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f1f6c6-6fa0-4ff9-8872-aea55737fd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03f1f6c6-6fa0-4ff9-8872-aea55737fd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1619682206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1e4f38-44e9-4931-ae66-85cd9fe04cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eef3c4240d4044870e990b29a519db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:13Z,use_quota=True,user_id='aeef26c0bec146049c1e64c274a93bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3929a76d-611a-49ee-9448-4413257c76ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3929a76d-611a-49ee-9448-4413257c76ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef73a161-710d-44f4-86b3-a90a2fdee927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:12 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:06:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef73a161-710d-44f4-86b3-a90a2fdee927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b1e4f38-44e9-4931-ae66-85cd9fe04cc2', 'volume_name': 'volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcca1d7d-e568-477b-85aa-c65fe46a2dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcca1d7d-e568-477b-85aa-c65fe46a2dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1c5dfd-345d-4eef-942a-192eb313fcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:13 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Volume 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:06:13 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Trying to clone 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:06:14 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:06:14 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:06:14 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c8d36e-081c-4150-8fa6-f092b995a54b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:14 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD Jun 29 03:06:14 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:15 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD" returned: 0 in 1.031s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:15 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 is fetched for user aeef26c0bec146049c1e64c274a93bbe. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:06:15 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0a7e34-b26e-40d6-91fb-18d41b005670]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:15 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD Jun 29 03:06:15 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:16 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD" returned: 0 in 1.155s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1619682206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b1e4f38-44e9-4931-ae66-85cd9fe04cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0eef3c4240d4044870e990b29a519db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:13Z,use_quota=True,user_id='aeef26c0bec146049c1e64c274a93bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Creating volume 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:16 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:16 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 1073741824 Jun 29 03:06:16 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:17 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:17 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:18 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 1073741824" returned: 0 in 1.387s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:18 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:18 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:18 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.076s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:06:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:06:19 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 0 in 1.316s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] <== create_volume: return (2770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.775s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:19 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Attempting download of ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:06:19 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbc985-8a60-4213-aae5-638558b5b8ec]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:19 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd Jun 29 03:06:19 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:20 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd" returned: 0 in 1.030s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:20 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd Jun 29 03:06:20 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:21 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd" returned: 1 in 0.860s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_x4__hfjd' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:06:21 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7244fc05-73a1-4e64-98a6-6e781f887c06]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:21 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD Jun 29 03:06:21 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:22 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD" returned: 0 in 0.911s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:22 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 was qcow2, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:06:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:22 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:22 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:24 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 0 in 2.540s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:24 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_d41mrygmdevstack@QuobyteHD, size 112.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:06:24 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Converted 112.00 MB image at 44.07 MB/s Jun 29 03:06:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:25 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 1G Jun 29 03:06:25 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Flow 'volume_create_manager' (9b1faf37-95f5-4a59-8ef1-88cc4ba33c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd876dc5-54d3-4e0e-833a-168110479892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd876dc5-54d3-4e0e-833a-168110479892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-886182218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347695ce-a442-419d-8095-6216c87b85be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fe7faac15a42fc882f4b598b98c8e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:25Z,use_quota=True,user_id='100dd3a94b0b431794cf1d62695ea61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f36f7f-65d9-4797-9509-af9187c15d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f36f7f-65d9-4797-9509-af9187c15d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd6b1e7-c05a-4dc2-9f1e-00339c3e4ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd6b1e7-c05a-4dc2-9f1e-00339c3e4ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '347695ce-a442-419d-8095-6216c87b85be', 'volume_name': 'volume-347695ce-a442-419d-8095-6216c87b85be', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f27ad9-f158-441a-9716-f9c97ac59244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f27ad9-f158-441a-9716-f9c97ac59244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7643912-f6c9-4527-8917-f7f237437e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Volume 347695ce-a442-419d-8095-6216c87b85be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-347695ce-a442-419d-8095-6216c87b85be', 'volume_size': 1} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-886182218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=347695ce-a442-419d-8095-6216c87b85be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fe7faac15a42fc882f4b598b98c8e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:25Z,use_quota=True,user_id='100dd3a94b0b431794cf1d62695ea61e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Creating volume 347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:25 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:25 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be 1073741824 Jun 29 03:06:25 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:25 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 1G" returned: 0 in 0.902s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c0588e-d13e-48f0-b167-56011277b4a4]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:26 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:26 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:26 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be 1073741824" returned: 0 in 1.089s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:26 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be Jun 29 03:06:26 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:26 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 0 in 0.990s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:27 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:27 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1bc99796-1598-4027-9967-5a6ac9fe22f8 tempest-GroupsTest-114722831 None] Group tempest-Group1-405820042: creating Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1bc99796-1598-4027-9967-5a6ac9fe22f8 tempest-GroupsTest-114722831 None] Group tempest-Group1-405820042: created successfully Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1bc99796-1598-4027-9967-5a6ac9fe22f8 tempest-GroupsTest-114722831 None] Create group completed successfully. Jun 29 03:06:27 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be" returned: 0 in 0.806s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7643912-f6c9-4527-8917-f7f237437e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-347695ce-a442-419d-8095-6216c87b85be', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157d0dcb-1999-4953-aa3a-328c8a8ef8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Volume volume-347695ce-a442-419d-8095-6216c87b85be (347695ce-a442-419d-8095-6216c87b85be): created successfully Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157d0dcb-1999-4953-aa3a-328c8a8ef8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Flow 'volume_create_manager' (9b1faf37-95f5-4a59-8ef1-88cc4ba33c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c6f90a5f-324a-47d5-8b74-0b62f137967d tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Created volume successfully. Jun 29 03:06:27 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 1 in 0.835s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Downloaded image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 for user aeef26c0bec146049c1e64c274a93bbe is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Marking volume 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Copying metadata from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 to 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Creating volume glance metadata for volume 1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 backed by image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1c5dfd-345d-4eef-942a-192eb313fcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbf85cd-d4c9-4450-821d-6d39c1b1569f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Volume volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 (1b1e4f38-44e9-4931-ae66-85cd9fe04cc2): created successfully Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbf85cd-d4c9-4450-821d-6d39c1b1569f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Flow 'volume_create_manager' (d12f002c-7c3b-4ae0-b06a-02b5c95856db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-81550b9c-8500-4f90-af16-9a42a657f241 tempest-VolumesImageMetadata-1087552414 None] Created volume successfully. Jun 29 03:06:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e8592b2e-4e27-4056-81c8-524ce71f7922 tempest-GroupsTest-114722831 None] Group tempest-Group2-398926599: creating Jun 29 03:06:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e8592b2e-4e27-4056-81c8-524ce71f7922 tempest-GroupsTest-114722831 None] Group tempest-Group2-398926599: created successfully Jun 29 03:06:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e8592b2e-4e27-4056-81c8-524ce71f7922 tempest-GroupsTest-114722831 None] Create group completed successfully. Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Acquiring lock "cinder-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Lock "cinder-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Acquiring lock "cinder-quobyte-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Creating offline snapshot 22ccf07a-2ff8-4623-bdef-615da517bbc7 of volume 347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Lock "cinder-quobyte-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7040791e-9182-4cfc-930c-23bd79c76dcd]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[890c0985-8112-42cf-8c0f-a2a90e0608f9]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:28 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be Jun 29 03:06:28 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:28 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:28 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:29 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 0 in 0.769s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:29 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be" returned: 0 in 0.820s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:29 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 1G Jun 29 03:06:29 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:29 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:29 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Flow 'volume_create_manager' (4de330a2-3dc8-4879-8d58-d0b392dd8626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9eaae1-918c-45c5-a768-4ada8365ec79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da9eaae1-918c-45c5-a768-4ada8365ec79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472486258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eeaa986-3953-4977-9ac8-3dbdc74e3f3e,host='devstack@QuobyteHD#QuobyteHD',id=f4a8d50e-3daa-4fe7-b1ea-8f4bee924277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3834b14974753b362cceae9331295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:30Z,use_quota=True,user_id='4fa214d67e5d461183af08bcbdad83cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e6725b-dae7-4fc4-8977-bbccd7f54ecd),volume_type_id=50e6725b-dae7-4fc4-8977-bbccd7f54ecd)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40310317-dfe4-4ab9-a129-f69df38da98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40310317-dfe4-4ab9-a129-f69df38da98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdb2824-867a-4468-b46d-f5933789f780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afdb2824-867a-4468-b46d-f5933789f780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4a8d50e-3daa-4fe7-b1ea-8f4bee924277', 'volume_name': 'volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532843c4-c0b8-44ea-a509-fab08ec8db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532843c4-c0b8-44ea-a509-fab08ec8db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d47257-240c-49e2-bee2-ae8beea115b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:30 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Volume f4a8d50e-3daa-4fe7-b1ea-8f4bee924277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277', 'volume_size': 1} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:30 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 1 in 0.913s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:30 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2 Jun 29 03:06:30 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:30 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 1G" returned: 0 in 0.955s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-347695ce-a442-419d-8095-6216c87b85be -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:30 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-347695ce-a442-419d-8095-6216c87b85be -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 Jun 29 03:06:30 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:31 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" returned: 0 in 0.681s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Lock "cinder-quobyte-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2" released by "delete_volume" :: held 2.425s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Created reservations ['0f7a2dad-6082-4f39-af17-d1eb129900ed', 'eb769ed2-c816-4413-b951-6de612cf353c', 'a08aa6f4-4f9d-4e05-b9f5-4703352ce430', '7d45e595-74d3-4fc9-934b-7cc773dce86c'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:31 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-347695ce-a442-419d-8095-6216c87b85be -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7" returned: 0 in 0.723s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:31 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 is being set with open permissions: ugo+rw Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:31 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 Jun 29 03:06:31 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:31 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:31 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:31 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7" returned: 0 in 0.715s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:32 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info Jun 29 03:06:32 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:32 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.851s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:32 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Deleted volume successfully. Jun 29 03:06:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2ab051db-1ca2-461c-b654-ec7a0210d0e5 tempest-VolumesImageMetadata-1087552414 None] Lock "cinder-1b1e4f38-44e9-4931-ae66-85cd9fe04cc2-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:33 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info" returned: 0 in 1.106s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:33 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info is being set with open permissions: ugo+rw Jun 29 03:06:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:33 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info Jun 29 03:06:33 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:34 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.info" returned: 0 in 1.106s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.550s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.971s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9eeaa986-3953-4977-9ac8-3dbdc74e3f3e,created_at=2026-06-29T01:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472486258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9eeaa986-3953-4977-9ac8-3dbdc74e3f3e,host='devstack@QuobyteHD#QuobyteHD',id=f4a8d50e-3daa-4fe7-b1ea-8f4bee924277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3834b14974753b362cceae9331295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:30Z,use_quota=True,user_id='4fa214d67e5d461183af08bcbdad83cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50e6725b-dae7-4fc4-8977-bbccd7f54ecd),volume_type_id=50e6725b-dae7-4fc4-8977-bbccd7f54ecd)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Creating volume f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:34 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:34 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 1073741824 Jun 29 03:06:34 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:34 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-32e57795-16e5-42ee-a0bd-b849ecf4d050 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Create snapshot completed successfully Jun 29 03:06:35 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 1073741824" returned: 0 in 0.938s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:35 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 Jun 29 03:06:35 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "cinder-22ccf07a-2ff8-4623-bdef-615da517bbc7-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-22ccf07a-2ff8-4623-bdef-615da517bbc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "cinder-quobyte-347695ce-a442-419d-8095-6216c87b85be" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-quobyte-347695ce-a442-419d-8095-6216c87b85be" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "cinder-quobyte-22ccf07a-2ff8-4623-bdef-615da517bbc7" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-quobyte-22ccf07a-2ff8-4623-bdef-615da517bbc7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Deleting offline snapshot 22ccf07a-2ff8-4623-bdef-615da517bbc7 of volume 347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] snapshot_file for this snap is: volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9135a994-b6f3-4110-9a77-3e1110270731]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:35 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 Jun 29 03:06:35 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:36 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277" returned: 0 in 0.797s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d47257-240c-49e2-bee2-ae8beea115b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3608833-ae59-4297-b637-36f2701d870e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:36 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Volume volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 (f4a8d50e-3daa-4fe7-b1ea-8f4bee924277): created successfully Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3608833-ae59-4297-b637-36f2701d870e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Flow 'volume_create_manager' (4de330a2-3dc8-4879-8d58-d0b392dd8626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-573f1455-a54f-4992-8868-44fbaae0e3ea tempest-GroupsTest-114722831 None] Created volume successfully. Jun 29 03:06:36 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7" returned: 0 in 1.152s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-347695ce-a442-419d-8095-6216c87b85be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[93123348-9e4f-4f34-8a60-a8617fa02413]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:37 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be Jun 29 03:06:37 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Acquiring lock "cinder-quobyte-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Lock "cinder-quobyte-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4fcbba-aa41-4d10-8c36-40440bc3a571]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:37 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 Jun 29 03:06:37 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:37 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be" returned: 0 in 0.893s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:37 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 Jun 29 03:06:37 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:38 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277" returned: 0 in 0.911s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:38 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277 Jun 29 03:06:38 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:38 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7" returned: 0 in 0.992s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:38 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7 Jun 29 03:06:38 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:38 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277" returned: 0 in 0.743s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Lock "cinder-quobyte-f4a8d50e-3daa-4fe7-b1ea-8f4bee924277" released by "delete_volume" :: held 1.715s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Created reservations ['ebef8c74-800f-4215-bc24-0d138094b048'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:39 devstack cinder-volume[93518]: WARNING cinder.quota [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1815548226 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1815548226, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:39 devstack cinder-volume[93518]: WARNING cinder.quota [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1815548226 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1815548226, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Created reservations ['0710799e-4a4f-421e-a894-da6e8224bd5d', 'c547f91b-48ee-457f-8405-73b46c19046c', '34235046-d685-4961-8d56-e050674a287c', '0083cb00-d35a-4de8-8eff-1cc1cd99f0c9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:39 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:39 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:39 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be.22ccf07a-2ff8-4623-bdef-615da517bbc7" returned: 0 in 0.869s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-quobyte-22ccf07a-2ff8-4623-bdef-615da517bbc7" released by "_delete_snapshot" :: held 4.113s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-quobyte-347695ce-a442-419d-8095-6216c87b85be" released by "delete_snapshot" :: held 4.161s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Created reservations ['6d07ffb3-7d2e-4166-adb0-203d631b38db', '57df866d-6cb9-4645-948e-21e3ab7aae64', '76669a61-fe88-4570-95ad-0e5dfabd986c', 'fdd6b7ef-80c8-4baf-8970-29835b7ce976'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Created reservations ['33e7d2ed-34ed-46d0-bbb0-e2c26fd082b5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Delete snapshot completed successfully. Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f4764b4a-00e3-4ac0-b3a3-862cccb7e3a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-22ccf07a-2ff8-4623-bdef-615da517bbc7-delete_snapshot" released by "delete_snapshot" :: held 4.601s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:40 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:40 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:40 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.399s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:40 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-63007d1b-bcb7-4f69-b384-5c1a19a6c058 tempest-GroupsTest-114722831 None] Delete group completed successfully. Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "cinder-347695ce-a442-419d-8095-6216c87b85be-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-347695ce-a442-419d-8095-6216c87b85be-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "cinder-quobyte-347695ce-a442-419d-8095-6216c87b85be" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-quobyte-347695ce-a442-419d-8095-6216c87b85be" acquired by "delete_volume" :: waited 0.034s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea245fd9-9dca-4029-9e38-91e39c027820]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:41 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be Jun 29 03:06:41 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:41 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.495s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:41 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dacda284-ad31-47ea-a957-4f3ee62f50c2 tempest-GroupsTest-114722831 None] Delete group completed successfully. Jun 29 03:06:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-918b1e9d-228a-489f-a225-c1825b566991 tempest-GroupsTest-114722831 None] Group tempest-GroupsTest-Group-64246831: creating Jun 29 03:06:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-918b1e9d-228a-489f-a225-c1825b566991 tempest-GroupsTest-114722831 None] Group tempest-GroupsTest-Group-64246831: created successfully Jun 29 03:06:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-918b1e9d-228a-489f-a225-c1825b566991 tempest-GroupsTest-114722831 None] Create group completed successfully. Jun 29 03:06:42 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be" returned: 0 in 1.349s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:42 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be Jun 29 03:06:42 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:43 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-347695ce-a442-419d-8095-6216c87b85be" returned: 0 in 1.028s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-quobyte-347695ce-a442-419d-8095-6216c87b85be" released by "delete_volume" :: held 2.532s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Created reservations ['94c39ca8-08e0-4b37-8f89-ccf01e431541', '3b2d5f75-3e32-4767-aa92-461b2fb3721f', '3989d91c-675a-4fdb-b842-614ebca32fd2', '27fae0c4-60f3-4b38-8b8f-bd0c258c40bf'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Flow 'volume_create_manager' (ebae8c7a-a667-4065-8f7e-4dd3e1de2330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cc876b-7fdf-4b2c-9713-e35c9398fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cc876b-7fdf-4b2c-9713-e35c9398fb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981798817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c110de4-c13e-4f5a-9187-e0ce0da29e06,host='devstack@QuobyteHD#QuobyteHD',id=e3d18055-e8e1-43fa-a58c-d70491504cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3834b14974753b362cceae9331295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:44Z,use_quota=True,user_id='4fa214d67e5d461183af08bcbdad83cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d02c974-3664-43a7-a665-576dc115f120),volume_type_id=5d02c974-3664-43a7-a665-576dc115f120)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ea3d10-10f4-419c-a910-320137a7a4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ea3d10-10f4-419c-a910-320137a7a4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12149082-575d-41ef-a0e4-875ce442a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12149082-575d-41ef-a0e4-875ce442a247) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3d18055-e8e1-43fa-a58c-d70491504cff', 'volume_name': 'volume-e3d18055-e8e1-43fa-a58c-d70491504cff', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02cbf190-cb8b-4ad1-bd58-c8a90624b8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02cbf190-cb8b-4ad1-bd58-c8a90624b8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7475d404-24b5-4679-b9e2-e2e605473c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:44 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Volume e3d18055-e8e1-43fa-a58c-d70491504cff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3d18055-e8e1-43fa-a58c-d70491504cff', 'volume_size': 1} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c110de4-c13e-4f5a-9187-e0ce0da29e06,created_at=2026-06-29T01:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981798817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c110de4-c13e-4f5a-9187-e0ce0da29e06,host='devstack@QuobyteHD#QuobyteHD',id=e3d18055-e8e1-43fa-a58c-d70491504cff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3834b14974753b362cceae9331295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:44Z,use_quota=True,user_id='4fa214d67e5d461183af08bcbdad83cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d02c974-3664-43a7-a665-576dc115f120),volume_type_id=5d02c974-3664-43a7-a665-576dc115f120)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Creating volume e3d18055-e8e1-43fa-a58c-d70491504cff {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:44 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:44 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff 1073741824 Jun 29 03:06:44 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:44 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:06:44 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:46 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff 1073741824" returned: 0 in 1.686s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:46 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.642s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:46 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:06:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Deleted volume successfully. Jun 29 03:06:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d43c2f5-2281-40e0-8d9b-010543db8f39 tempest-VolumeSnapshotQuotasNegativeTestJSON-1423324512 None] Lock "cinder-347695ce-a442-419d-8095-6216c87b85be-delete_volume" released by "delete_volume" :: held 4.972s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:46 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff Jun 29 03:06:46 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:47 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff" returned: 0 in 1.115s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] <== create_volume: return (2916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.922s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7475d404-24b5-4679-b9e2-e2e605473c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3d18055-e8e1-43fa-a58c-d70491504cff', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3f5d00-d145-4931-9c05-8836baa2217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:47 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Volume volume-e3d18055-e8e1-43fa-a58c-d70491504cff (e3d18055-e8e1-43fa-a58c-d70491504cff): created successfully Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3f5d00-d145-4931-9c05-8836baa2217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Flow 'volume_create_manager' (ebae8c7a-a667-4065-8f7e-4dd3e1de2330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-668ba009-0fae-41d8-a67e-aabee3db76fb tempest-GroupsTest-114722831 None] Created volume successfully. Jun 29 03:06:49 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:06:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Flow 'volume_create_manager' (8d443630-00a2-45fe-a886-dba0a4894e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331edca5-c485-4994-8a33-2369f3c9eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331edca5-c485-4994-8a33-2369f3c9eed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533364542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c110de4-c13e-4f5a-9187-e0ce0da29e06,host='devstack@QuobyteHD#QuobyteHD',id=c36a11d4-808c-428c-9bb9-00563fb94b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3834b14974753b362cceae9331295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:50Z,use_quota=True,user_id='4fa214d67e5d461183af08bcbdad83cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d02c974-3664-43a7-a665-576dc115f120),volume_type_id=5d02c974-3664-43a7-a665-576dc115f120)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12dd9251-9b43-40bf-9cbb-86fa98fdef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12dd9251-9b43-40bf-9cbb-86fa98fdef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac56876-cff0-4796-bb19-a8dea883d80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac56876-cff0-4796-bb19-a8dea883d80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36a11d4-808c-428c-9bb9-00563fb94b06', 'volume_name': 'volume-c36a11d4-808c-428c-9bb9-00563fb94b06', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f260f4c1-fcd2-41f1-9fc8-5edc88046ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f260f4c1-fcd2-41f1-9fc8-5edc88046ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eec4db-2cea-43f5-bd17-343effa18bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:50 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Volume c36a11d4-808c-428c-9bb9-00563fb94b06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36a11d4-808c-428c-9bb9-00563fb94b06', 'volume_size': 1} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c110de4-c13e-4f5a-9187-e0ce0da29e06,created_at=2026-06-29T01:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-533364542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c110de4-c13e-4f5a-9187-e0ce0da29e06,host='devstack@QuobyteHD#QuobyteHD',id=c36a11d4-808c-428c-9bb9-00563fb94b06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32f3834b14974753b362cceae9331295',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:50Z,use_quota=True,user_id='4fa214d67e5d461183af08bcbdad83cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d02c974-3664-43a7-a665-576dc115f120),volume_type_id=5d02c974-3664-43a7-a665-576dc115f120)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Creating volume c36a11d4-808c-428c-9bb9-00563fb94b06 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:50 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:50 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 1073741824 Jun 29 03:06:50 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:51 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 1073741824" returned: 0 in 1.561s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:06:51 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 Jun 29 03:06:51 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Flow 'volume_create_manager' (9190bf85-b8f3-46a7-8696-607d0b699287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3556a1a7-dab8-4c2c-a754-f379753f3ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3556a1a7-dab8-4c2c-a754-f379753f3ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-44349391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20f9aa9-4c69-4da8-900b-03d74a32f8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f686cc0ad47c4cccb0f543620f37dd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:52Z,use_quota=True,user_id='2b2bd4d4d9e84afdb24f58ab691b9f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdfa702-6ea5-488b-b1a7-b0f085f28872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fdfa702-6ea5-488b-b1a7-b0f085f28872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e18fc6-63d7-4fb6-9e7a-73229a9c92be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e18fc6-63d7-4fb6-9e7a-73229a9c92be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e20f9aa9-4c69-4da8-900b-03d74a32f8f8', 'volume_name': 'volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06eeeefd-6a70-4dd9-80d6-145dbbc6bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06eeeefd-6a70-4dd9-80d6-145dbbc6bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67edfa0-c4eb-45c9-b70f-2820559f771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Volume e20f9aa9-4c69-4da8-900b-03d74a32f8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8', 'volume_size': 1} Jun 29 03:06:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:52 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06" returned: 0 in 0.863s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] <== create_volume: return (2515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.522s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.717s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-44349391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e20f9aa9-4c69-4da8-900b-03d74a32f8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f686cc0ad47c4cccb0f543620f37dd56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:06:52Z,use_quota=True,user_id='2b2bd4d4d9e84afdb24f58ab691b9f6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Creating volume e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:06:52 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eec4db-2cea-43f5-bd17-343effa18bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36a11d4-808c-428c-9bb9-00563fb94b06', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0ee438-a04e-42d9-ad69-df61f1b635ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:52 devstack sudo[101166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 1073741824 Jun 29 03:06:52 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:52 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Volume volume-c36a11d4-808c-428c-9bb9-00563fb94b06 (c36a11d4-808c-428c-9bb9-00563fb94b06): created successfully Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0ee438-a04e-42d9-ad69-df61f1b635ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Flow 'volume_create_manager' (8d443630-00a2-45fe-a886-dba0a4894e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ec096600-d65e-46a2-ba9e-123245321f06 tempest-GroupsTest-114722831 None] Created volume successfully. Jun 29 03:06:53 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=105,cinder:UPDATE=115,cinder:INSERT=36,cinder:DELETE=6 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:06:53 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=109,cinder:INSERT=34,cinder:UPDATE=131,cinder:DELETE=10 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:06:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8d2ecdc0-0b29-4c03-b43b-cea2455e5c5a tempest-GroupsTest-114722831 None] Update group completed successfully. Jun 29 03:06:53 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 1073741824" returned: 0 in 1.153s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:53 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:06:53 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:54 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 0.722s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67edfa0-c4eb-45c9-b70f-2820559f771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd76b856-8398-48f2-a42c-9025da90b749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:06:54 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Volume volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 (e20f9aa9-4c69-4da8-900b-03d74a32f8f8): created successfully Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd76b856-8398-48f2-a42c-9025da90b749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:06:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Flow 'volume_create_manager' (9190bf85-b8f3-46a7-8696-607d0b699287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:06:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d7891d37-f1ab-47e0-aa34-63003cf5277f tempest-VolumesActionsTest-2053694634 None] Created volume successfully. Jun 29 03:06:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-66820cb3-b4fe-465a-be69-20a2a85628d7 tempest-GroupsTest-114722831 None] Update group completed successfully. Jun 29 03:06:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Acquiring lock "cinder-quobyte-c36a11d4-808c-428c-9bb9-00563fb94b06" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Lock "cinder-quobyte-c36a11d4-808c-428c-9bb9-00563fb94b06" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf568b-57b6-4234-8946-84208387db00]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:56 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 Jun 29 03:06:56 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:57 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:57 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06 Jun 29 03:06:57 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:58 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c36a11d4-808c-428c-9bb9-00563fb94b06" returned: 0 in 0.768s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Lock "cinder-quobyte-c36a11d4-808c-428c-9bb9-00563fb94b06" released by "delete_volume" :: held 1.655s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Acquiring lock "cinder-quobyte-e3d18055-e8e1-43fa-a58c-d70491504cff" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:06:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Lock "cinder-quobyte-e3d18055-e8e1-43fa-a58c-d70491504cff" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:06:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a3148d-27f6-405c-bad6-81381209b76b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:06:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:58 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff Jun 29 03:06:58 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:59 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:06:59 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff Jun 29 03:06:59 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:06:59 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jun 29 03:06:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e3d18055-e8e1-43fa-a58c-d70491504cff" returned: 0 in 0.662s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:06:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Lock "cinder-quobyte-e3d18055-e8e1-43fa-a58c-d70491504cff" released by "delete_volume" :: held 1.528s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:06:59 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Created reservations ['05d8e962-f66e-4f7d-b3fc-a0da3c664567'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:06:59 devstack cinder-volume[93518]: WARNING cinder.quota [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1565532905 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1565532905, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:59 devstack cinder-volume[93518]: WARNING cinder.quota [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1565532905 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1565532905, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:06:59 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Created reservations ['58a09ccb-fce6-446f-93b2-3a3190532a03', '86b050d2-b6ed-4184-9247-cbf947051923', '997900bf-4e3b-44e1-9511-93234960da91', 'e0b85a06-81f0-496b-8391-9fc45a307937'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Created reservations ['e555b67b-cb39-4554-8f1e-3a3c3b1a0d8d', '8ec14dc0-b1ba-4f52-b8e5-42277d4aed72', '1b984aa2-e039-47d6-974a-247414788520', '49316e5e-7b9d-4a5f-89cf-c829805038cd'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:00 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:00 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:01 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.866s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:01 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-90dd1971-39bc-4a2f-ab05-2264b73fd05d tempest-GroupsTest-114722831 None] Delete group completed successfully. Jun 29 03:07:03 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Flow 'volume_create_manager' (7ff94d77-6e63-4c87-bccc-644cd9ed654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1016de28-d42d-4d60-ab80-46adafd9d7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1016de28-d42d-4d60-ab80-46adafd9d7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1292156921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a38480-8b3a-48aa-91de-b41c58b038c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f805ab3bdc43bf991daf4ff8866316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:04Z,use_quota=True,user_id='1a5495c2bb4f4ae59097a5306b3fdee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335c9973-12c9-4914-a2bd-99afe91e2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335c9973-12c9-4914-a2bd-99afe91e2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba71edd1-92bd-416c-82c7-b225dab03562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba71edd1-92bd-416c-82c7-b225dab03562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a38480-8b3a-48aa-91de-b41c58b038c6', 'volume_name': 'volume-17a38480-8b3a-48aa-91de-b41c58b038c6', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e625d2f-c049-484e-bbdb-1f9f7fc4e9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e625d2f-c049-484e-bbdb-1f9f7fc4e9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97821bd-ce52-412c-a20f-3996ed189321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Volume 17a38480-8b3a-48aa-91de-b41c58b038c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a38480-8b3a-48aa-91de-b41c58b038c6', 'volume_size': 1} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1292156921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a38480-8b3a-48aa-91de-b41c58b038c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96f805ab3bdc43bf991daf4ff8866316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:04Z,use_quota=True,user_id='1a5495c2bb4f4ae59097a5306b3fdee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Creating volume 17a38480-8b3a-48aa-91de-b41c58b038c6 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:04 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:04 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 1073741824 Jun 29 03:07:04 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:05 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 1073741824" returned: 0 in 1.104s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:05 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 Jun 29 03:07:05 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:05 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6" returned: 0 in 0.677s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97821bd-ce52-412c-a20f-3996ed189321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a38480-8b3a-48aa-91de-b41c58b038c6', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde40d21-b926-472d-bea3-e0d405b86951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:05 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Volume volume-17a38480-8b3a-48aa-91de-b41c58b038c6 (17a38480-8b3a-48aa-91de-b41c58b038c6): created successfully Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde40d21-b926-472d-bea3-e0d405b86951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Flow 'volume_create_manager' (7ff94d77-6e63-4c87-bccc-644cd9ed654a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7b98ebf3-a159-4ac1-a7ba-bbe01e0d547e tempest-VolumesMetadataTest-552589872 None] Created volume successfully. Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Flow 'volume_create_manager' (746be5c1-d7a2-410c-9cae-6e36d3ba1390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7204bf-a87e-4d28-8114-3faccf4ac94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b7204bf-a87e-4d28-8114-3faccf4ac94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-276000930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e853a469-77fc-4550-b7db-b06081eed7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15c700c128c49ca8ca67ae1b5504304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:07Z,use_quota=True,user_id='8f0f65f7f8b847a89c7fee68385003f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4bd5bc-a11d-4dd0-8144-e3b229c14a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4bd5bc-a11d-4dd0-8144-e3b229c14a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ebeba8-1c15-4867-b592-011cccd8f70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1ebeba8-1c15-4867-b592-011cccd8f70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e853a469-77fc-4550-b7db-b06081eed7fe', 'volume_name': 'volume-e853a469-77fc-4550-b7db-b06081eed7fe', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bacfa7-f2d9-4ba3-8f57-26cf099b3cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82bacfa7-f2d9-4ba3-8f57-26cf099b3cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afd1bbf-7115-470b-be73-d7ca52b6fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Volume e853a469-77fc-4550-b7db-b06081eed7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e853a469-77fc-4550-b7db-b06081eed7fe', 'volume_size': 1} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-276000930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e853a469-77fc-4550-b7db-b06081eed7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f15c700c128c49ca8ca67ae1b5504304',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:07Z,use_quota=True,user_id='8f0f65f7f8b847a89c7fee68385003f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Creating volume e853a469-77fc-4550-b7db-b06081eed7fe {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:06 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:06 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe 1073741824 Jun 29 03:07:06 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:07 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe 1073741824" returned: 0 in 1.004s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Acquiring lock "cinder-17a38480-8b3a-48aa-91de-b41c58b038c6-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:07 devstack sudo[101264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe Jun 29 03:07:07 devstack sudo[101264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Lock "cinder-17a38480-8b3a-48aa-91de-b41c58b038c6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Acquiring lock "cinder-quobyte-17a38480-8b3a-48aa-91de-b41c58b038c6" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Lock "cinder-quobyte-17a38480-8b3a-48aa-91de-b41c58b038c6" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411426d-ab73-4f0f-bd28-f00a0c83f463]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:08 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 Jun 29 03:07:08 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:08 devstack sudo[101264]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe" returned: 0 in 0.795s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2afd1bbf-7115-470b-be73-d7ca52b6fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e853a469-77fc-4550-b7db-b06081eed7fe', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c349828e-e1a1-466c-9b51-e289b93986c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:08 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Volume volume-e853a469-77fc-4550-b7db-b06081eed7fe (e853a469-77fc-4550-b7db-b06081eed7fe): created successfully Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c349828e-e1a1-466c-9b51-e289b93986c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Flow 'volume_create_manager' (746be5c1-d7a2-410c-9cae-6e36d3ba1390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c5cbad8e-3df0-4b5b-9190-27bfdeeddd4b tempest-AttachVolumeShelveTestJSON-339706289 None] Created volume successfully. Jun 29 03:07:08 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6" returned: 0 in 0.906s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:08 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6 Jun 29 03:07:08 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:09 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17a38480-8b3a-48aa-91de-b41c58b038c6" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Lock "cinder-quobyte-17a38480-8b3a-48aa-91de-b41c58b038c6" released by "delete_volume" :: held 1.722s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Created reservations ['7ca28e82-2a68-496d-8c6d-df1e00a56c7d', '3d30ee8f-908f-4642-8f98-98da594e0840', '69cd02d4-9036-401a-866c-7788085f25af', 'f81c4649-c08d-47c1-952f-ba7f8a63c2f5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:09 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:09 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:11 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.476s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:11 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:11 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Deleted volume successfully. Jun 29 03:07:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1c69892b-bb6a-4b50-8a6c-90d732e226ad tempest-VolumesMetadataTest-552589872 None] Lock "cinder-17a38480-8b3a-48aa-91de-b41c58b038c6-delete_volume" released by "delete_volume" :: held 3.547s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e0571069-b8ec-46ea-bbd5-c2cfdfc793dc tempest-VolumesActionsTest-2053694634 None] Acquiring lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" by "attach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e0571069-b8ec-46ea-bbd5-c2cfdfc793dc tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" acquired by "attach_volume" :: waited 0.056s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e0571069-b8ec-46ea-bbd5-c2cfdfc793dc tempest-VolumesActionsTest-2053694634 None] Attaching volume e20f9aa9-4c69-4da8-900b-03d74a32f8f8 to instance ac39c9e9-8b67-487a-aa70-f480695f4317 at mountpoint /dev/vdb on host None. Jun 29 03:07:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e0571069-b8ec-46ea-bbd5-c2cfdfc793dc tempest-VolumesActionsTest-2053694634 None] Attach volume completed successfully. Jun 29 03:07:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e0571069-b8ec-46ea-bbd5-c2cfdfc793dc tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" released by "attach_volume" :: held 0.374s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d01cbc8-df01-4a01-93cb-48a5b02e3008 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-detach_volume" by "detach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d01cbc8-df01-4a01-93cb-48a5b02e3008 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:15 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8d01cbc8-df01-4a01-93cb-48a5b02e3008 tempest-VolumesActionsTest-2053694634 None] Detaching volume e20f9aa9-4c69-4da8-900b-03d74a32f8f8 from instance ac39c9e9-8b67-487a-aa70-f480695f4317. Jun 29 03:07:15 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8d01cbc8-df01-4a01-93cb-48a5b02e3008 tempest-VolumesActionsTest-2053694634 None] Detach volume completed successfully. Jun 29 03:07:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d01cbc8-df01-4a01-93cb-48a5b02e3008 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-detach_volume" released by "detach_volume" :: held 0.127s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:16 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Flow 'volume_create_manager' (2e357d71-c498-43ef-abf5-faa46d919ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9ff578-e497-4910-a92b-09c30de15ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9ff578-e497-4910-a92b-09c30de15ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1425676239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88f978e-decf-4d51-8f65-cc662b973b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d358b46d8a3b42e5adf5e97823e94dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:17Z,use_quota=True,user_id='3abed72f5f3c4b0390de5ac41b7f4540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f829bea4-3990-45a9-925b-aadcb3eecfdb),volume_type_id=f829bea4-3990-45a9-925b-aadcb3eecfdb)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1b9a38-49dd-48e8-96cf-b98bce74ff39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c1b9a38-49dd-48e8-96cf-b98bce74ff39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78085a8c-a6cd-4ff8-9119-0bfd9ecf1fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78085a8c-a6cd-4ff8-9119-0bfd9ecf1fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88f978e-decf-4d51-8f65-cc662b973b8f', 'volume_name': 'volume-a88f978e-decf-4d51-8f65-cc662b973b8f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10c9a7c-0b5c-45b0-b768-d90bec9ac61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10c9a7c-0b5c-45b0-b768-d90bec9ac61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fea157-2425-440c-acd9-3b936e163a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Volume a88f978e-decf-4d51-8f65-cc662b973b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88f978e-decf-4d51-8f65-cc662b973b8f', 'volume_size': 1} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1425676239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a88f978e-decf-4d51-8f65-cc662b973b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d358b46d8a3b42e5adf5e97823e94dc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:17Z,use_quota=True,user_id='3abed72f5f3c4b0390de5ac41b7f4540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f829bea4-3990-45a9-925b-aadcb3eecfdb),volume_type_id=f829bea4-3990-45a9-925b-aadcb3eecfdb)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Creating volume a88f978e-decf-4d51-8f65-cc662b973b8f {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:17 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:17 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f 1073741824 Jun 29 03:07:17 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:17 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:17 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:18 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f 1073741824" returned: 0 in 1.390s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:18 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f Jun 29 03:07:18 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:18 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.137s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:07:18 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Flow 'volume_create_manager' (4f8427ea-ca3c-42a0-9213-8a9ebd9b32a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5908f4d2-d6cd-4a6d-aed2-3d3702855d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5908f4d2-d6cd-4a6d-aed2-3d3702855d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1751165104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec774ff-7162-457c-b95b-05982d10e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2642f890f4c4aaa30d6f7343c522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:19Z,use_quota=True,user_id='b2e87c9fe4c245bfbe713fbf7ac4c5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5039ddb4-7080-4f28-a4df-971838cdf8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5039ddb4-7080-4f28-a4df-971838cdf8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8b8343-f64d-4adf-8a1b-4b9f441a29ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8b8343-f64d-4adf-8a1b-4b9f441a29ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ec774ff-7162-457c-b95b-05982d10e652', 'volume_name': 'volume-7ec774ff-7162-457c-b95b-05982d10e652', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e032c9df-f196-47c5-8882-24209758b271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e032c9df-f196-47c5-8882-24209758b271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962e965a-2f23-4769-b999-e92aaaf6b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Volume 7ec774ff-7162-457c-b95b-05982d10e652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ec774ff-7162-457c-b95b-05982d10e652', 'volume_size': 1} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:19 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f" returned: 0 in 0.994s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] <== create_volume: return (2478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.480s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1751165104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ec774ff-7162-457c-b95b-05982d10e652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2642f890f4c4aaa30d6f7343c522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:19Z,use_quota=True,user_id='b2e87c9fe4c245bfbe713fbf7ac4c5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Creating volume 7ec774ff-7162-457c-b95b-05982d10e652 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:19 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:19 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 1073741824 Jun 29 03:07:19 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fea157-2425-440c-acd9-3b936e163a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88f978e-decf-4d51-8f65-cc662b973b8f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ace4400-1170-4762-83d2-1c70c59e885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Volume volume-a88f978e-decf-4d51-8f65-cc662b973b8f (a88f978e-decf-4d51-8f65-cc662b973b8f): created successfully Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ace4400-1170-4762-83d2-1c70c59e885e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Flow 'volume_create_manager' (2e357d71-c498-43ef-abf5-faa46d919ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-301747ab-609e-46da-a05b-17fdf6af9471 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Created volume successfully. Jun 29 03:07:20 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 1073741824" returned: 0 in 1.096s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:20 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:20 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:20 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 Jun 29 03:07:20 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:21 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652" returned: 0 in 0.760s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962e965a-2f23-4769-b999-e92aaaf6b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ec774ff-7162-457c-b95b-05982d10e652', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:21 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77feb17-0f43-4e03-851f-d033ac276e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.840s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e75636a6-26eb-406f-a9ff-07253a7c55e2 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Retype volume completed successfully. Jun 29 03:07:21 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Volume volume-7ec774ff-7162-457c-b95b-05982d10e652 (7ec774ff-7162-457c-b95b-05982d10e652): created successfully Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77feb17-0f43-4e03-851f-d033ac276e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Flow 'volume_create_manager' (4f8427ea-ca3c-42a0-9213-8a9ebd9b32a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-957d75dc-cb53-4289-8c2b-aa6d8f656af7 tempest-VolumesTransfersTest-847601935 None] Created volume successfully. Jun 29 03:07:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Acquiring lock "cinder-a88f978e-decf-4d51-8f65-cc662b973b8f-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "cinder-a88f978e-decf-4d51-8f65-cc662b973b8f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Acquiring lock "cinder-quobyte-a88f978e-decf-4d51-8f65-cc662b973b8f" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "cinder-quobyte-a88f978e-decf-4d51-8f65-cc662b973b8f" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f017bf-9313-47f1-a61a-f6a0e31cedff]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:22 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f Jun 29 03:07:22 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0fab446a-436c-4f34-baf9-c8f3e009bfc2 tempest-VolumesTransfersTest-1773919450 None] Transfer volume completed successfully. Jun 29 03:07:23 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f" returned: 0 in 0.846s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:23 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f Jun 29 03:07:23 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:23 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a88f978e-decf-4d51-8f65-cc662b973b8f" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "cinder-quobyte-a88f978e-decf-4d51-8f65-cc662b973b8f" released by "delete_volume" :: held 1.661s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Acquiring lock "cinder-7ec774ff-7162-457c-b95b-05982d10e652-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:23 devstack cinder-volume[93518]: WARNING cinder.quota [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:07:23 devstack cinder-volume[93518]: WARNING cinder.quota [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Lock "cinder-7ec774ff-7162-457c-b95b-05982d10e652-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Created reservations ['e3e04dd3-867d-4a60-b941-dfe000c92e9e', '025c78bc-1bb6-4e1c-93fc-86a7c5291a0f', '6f917817-fa77-4442-a99e-997382700e5c', '4885a11b-656b-4554-915b-bcb404809f30'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Acquiring lock "cinder-quobyte-7ec774ff-7162-457c-b95b-05982d10e652" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Lock "cinder-quobyte-7ec774ff-7162-457c-b95b-05982d10e652" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[094ee8a9-af69-4bf1-93ee-cf7f40c9423b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:24 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:24 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:24 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 Jun 29 03:07:24 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:25 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:25 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652" returned: 0 in 1.201s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.165s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:25 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:25 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Deleted volume successfully. Jun 29 03:07:25 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652 Jun 29 03:07:25 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-18f78f02-4301-4f27-a66b-d536ec02ea18 tempest-VolumeRetypeWithoutMigrationTest-1559325406 None] Lock "cinder-a88f978e-decf-4d51-8f65-cc662b973b8f-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:26 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7ec774ff-7162-457c-b95b-05982d10e652" returned: 0 in 0.858s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Lock "cinder-quobyte-7ec774ff-7162-457c-b95b-05982d10e652" released by "delete_volume" :: held 2.130s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Created reservations ['d9cde528-57f9-49aa-8ecc-2312dbdc2ee1', '887f41fb-413b-4791-b079-6408bfc5248c', '8b021ef3-8654-49dc-814f-857c74bc8bdc', 'b646497e-24c4-464b-b061-fe24146888dc'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:26 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:26 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:27 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.905s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Deleted volume successfully. Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d78a41e8-17ca-4a20-a6bf-3eff3cc010ce tempest-VolumesTransfersTest-48707473 None] Lock "cinder-7ec774ff-7162-457c-b95b-05982d10e652-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Flow 'volume_create_manager' (9828c549-70de-4b48-b2f6-fcfd1bb7d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def1ad36-7226-42b4-905e-a9eacac94844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (def1ad36-7226-42b4-905e-a9eacac94844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-586903509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c240d225-a1e1-4bb9-af32-e14b8bfc6dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2642f890f4c4aaa30d6f7343c522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:28Z,use_quota=True,user_id='b2e87c9fe4c245bfbe713fbf7ac4c5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d2dde1-c349-48fa-9c4a-a56a240d4d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d2dde1-c349-48fa-9c4a-a56a240d4d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6eb840-e603-4b02-8d5d-4d1ef491d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6eb840-e603-4b02-8d5d-4d1ef491d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c240d225-a1e1-4bb9-af32-e14b8bfc6dbb', 'volume_name': 'volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac3ed83-4600-4d69-91f1-c0dfaeabacb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac3ed83-4600-4d69-91f1-c0dfaeabacb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d6fb8-6e1d-4541-a395-61c7fb9e57e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:27 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Volume c240d225-a1e1-4bb9-af32-e14b8bfc6dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb', 'volume_size': 1} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-586903509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c240d225-a1e1-4bb9-af32-e14b8bfc6dbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95b2642f890f4c4aaa30d6f7343c522c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:28Z,use_quota=True,user_id='b2e87c9fe4c245bfbe713fbf7ac4c5cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Creating volume c240d225-a1e1-4bb9-af32-e14b8bfc6dbb {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:28 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:28 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb 1073741824 Jun 29 03:07:28 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:28 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb 1073741824" returned: 0 in 0.955s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-3aa2f1b6-9d94-41cb-9c30-311da0ce5836 req-a6b1540b-cd28-47d0-99d6-b47ab5fe3997 tempest-AttachVolumeShelveTestJSON-339706289 None] No connector for attachment 5d6fd49a-804b-41c2-a942-2bee9ec26a6a; skipping storage backend terminate_connection call. {{(pid=93518) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 29 03:07:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-3aa2f1b6-9d94-41cb-9c30-311da0ce5836 req-a6b1540b-cd28-47d0-99d6-b47ab5fe3997 tempest-AttachVolumeShelveTestJSON-339706289 None] Deleting attachment 5d6fd49a-804b-41c2-a942-2bee9ec26a6a. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:07:29 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb Jun 29 03:07:29 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:29 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb" returned: 0 in 0.982s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d6fb8-6e1d-4541-a395-61c7fb9e57e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c61da4-b987-42e6-b31a-993d4af71673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:30 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Volume volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb (c240d225-a1e1-4bb9-af32-e14b8bfc6dbb): created successfully Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11c61da4-b987-42e6-b31a-993d4af71673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Flow 'volume_create_manager' (9828c549-70de-4b48-b2f6-fcfd1bb7d76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:30 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8f9ef4f7-c0aa-4064-a2ea-b804678cff4d tempest-VolumesTransfersTest-847601935 None] Created volume successfully. Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Acquiring lock "cinder-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Lock "cinder-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Acquiring lock "cinder-quobyte-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Lock "cinder-quobyte-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[75056b25-bb6b-4f03-b592-7f71ec491f34]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:31 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb Jun 29 03:07:31 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Flow 'volume_create_manager' (2f061325-cded-4fd6-9ae4-ad9a1d23067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabdbbfc-270b-4c76-ae0d-cb7467a8998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabdbbfc-270b-4c76-ae0d-cb7467a8998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-595581124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f32ca6e-51fe-4d38-b8f1-a7f005b3010a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec7f2ee951745b09fd34ad26539741b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:32Z,use_quota=True,user_id='27a6a58bf4074bc2ab557720806c3752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63df3f2b-3bde-4cfd-8c85-6c402770adef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63df3f2b-3bde-4cfd-8c85-6c402770adef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06797644-9384-4bc2-be02-907b5ba041f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06797644-9384-4bc2-be02-907b5ba041f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f32ca6e-51fe-4d38-b8f1-a7f005b3010a', 'volume_name': 'volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7e6e4a-b268-4b45-9726-2067d3e45aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7e6e4a-b268-4b45-9726-2067d3e45aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be428ee-f0ba-4371-8db6-b9dc0272f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:32 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Volume 8f32ca6e-51fe-4d38-b8f1-a7f005b3010a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a', 'volume_size': 1} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-595581124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f32ca6e-51fe-4d38-b8f1-a7f005b3010a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aec7f2ee951745b09fd34ad26539741b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:32Z,use_quota=True,user_id='27a6a58bf4074bc2ab557720806c3752',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Creating volume 8f32ca6e-51fe-4d38-b8f1-a7f005b3010a {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:32 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:32 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a 1073741824 Jun 29 03:07:32 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:32 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb" returned: 0 in 0.899s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:32 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb Jun 29 03:07:32 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:32 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a 1073741824" returned: 0 in 0.923s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:33 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a Jun 29 03:07:33 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:33 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Lock "cinder-quobyte-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb" released by "delete_volume" :: held 1.695s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Created reservations ['a81aee34-08d5-4708-a5e9-6d92598b60e0', 'c8e9b120-a70c-4f62-97ed-26b5be250ec1', '5a79fcc3-4f81-4249-b91a-5aef4b1fc7f5', '32ab9524-dd88-45e5-a3d3-2c5e09f961d8'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:33 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:33 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:33 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a" returned: 0 in 0.786s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be428ee-f0ba-4371-8db6-b9dc0272f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d585612-41c4-4702-a070-832fb15ee6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:33 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Volume volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a (8f32ca6e-51fe-4d38-b8f1-a7f005b3010a): created successfully Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d585612-41c4-4702-a070-832fb15ee6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Flow 'volume_create_manager' (2f061325-cded-4fd6-9ae4-ad9a1d23067e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a78ee40f-7e32-4d11-aa71-d75ff11e6155 tempest-VolumesServicesTestJSON-1442543953 None] Created volume successfully. Jun 29 03:07:34 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.874s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:34 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:34 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Deleted volume successfully. Jun 29 03:07:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-58e33a0e-6375-4e70-afbd-21934f9c8c1b tempest-VolumesTransfersTest-48707473 None] Lock "cinder-c240d225-a1e1-4bb9-af32-e14b8bfc6dbb-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Acquiring lock "cinder-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Lock "cinder-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Acquiring lock "cinder-quobyte-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Lock "cinder-quobyte-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8a7a91-994e-466f-9874-a5e3e843ea68]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:35 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a Jun 29 03:07:35 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:36 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a" returned: 0 in 0.945s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:36 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a Jun 29 03:07:36 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:37 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Lock "cinder-quobyte-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a" released by "delete_volume" :: held 1.814s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Created reservations ['d84edea8-0e40-47eb-9f92-bef43af4d9e1', 'a7c08a3e-a19f-415c-bbf6-ae2163b37aed', '5c5b0ed7-85ca-4b32-9fdd-7eab17a77016', '385fa5c8-a4ee-447b-80e3-93eacf03ebb0'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:37 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:37 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:38 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.018s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:38 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Deleted volume successfully. Jun 29 03:07:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-070e6ee9-895d-4cca-ad34-9b81488b3732 tempest-VolumesServicesTestJSON-1442543953 None] Lock "cinder-8f32ca6e-51fe-4d38-b8f1-a7f005b3010a-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e4b1d61-f740-447b-bf1c-6a342f68acf7 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" by "attach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e4b1d61-f740-447b-bf1c-6a342f68acf7 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" acquired by "attach_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8e4b1d61-f740-447b-bf1c-6a342f68acf7 tempest-VolumesActionsTest-2053694634 None] Attaching volume e20f9aa9-4c69-4da8-900b-03d74a32f8f8 to instance 6a2d9bcd-5a9a-4b91-bee0-be0b8e19f713 at mountpoint /dev/vdb on host None. Jun 29 03:07:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8e4b1d61-f740-447b-bf1c-6a342f68acf7 tempest-VolumesActionsTest-2053694634 None] Attach volume completed successfully. Jun 29 03:07:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e4b1d61-f740-447b-bf1c-6a342f68acf7 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" released by "attach_volume" :: held 0.175s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e82fa15c-64aa-4fda-9e87-5fe87ae9aa44 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-detach_volume" by "detach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e82fa15c-64aa-4fda-9e87-5fe87ae9aa44 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e82fa15c-64aa-4fda-9e87-5fe87ae9aa44 tempest-VolumesActionsTest-2053694634 None] Detaching volume e20f9aa9-4c69-4da8-900b-03d74a32f8f8 from instance 6a2d9bcd-5a9a-4b91-bee0-be0b8e19f713. Jun 29 03:07:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e82fa15c-64aa-4fda-9e87-5fe87ae9aa44 tempest-VolumesActionsTest-2053694634 None] Detach volume completed successfully. Jun 29 03:07:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e82fa15c-64aa-4fda-9e87-5fe87ae9aa44 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Flow 'volume_create_manager' (8ae86734-098b-4da5-8316-9e2923ebc519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18363b1-6d83-4445-9764-098de5023a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18363b1-6d83-4445-9764-098de5023a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1442258560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff25d6d8-cf75-4d64-8441-dc1ddbdf997c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc1d6e5a114665a8b6a42f5e4602d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:47Z,use_quota=True,user_id='0070d0a2a4a844f4a23bc2b3f09005cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b6d863-03c7-479c-8c3f-401052abbd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b6d863-03c7-479c-8c3f-401052abbd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73b886a-0f82-4c4e-bf3c-0b169b19ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b73b886a-0f82-4c4e-bf3c-0b169b19ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff25d6d8-cf75-4d64-8441-dc1ddbdf997c', 'volume_name': 'volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1f68d6-c9b1-4969-b858-07cbb1857ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf1f68d6-c9b1-4969-b858-07cbb1857ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ef0846-6519-4c85-8794-58c8b596ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:46 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Volume ff25d6d8-cf75-4d64-8441-dc1ddbdf997c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c', 'volume_size': 1} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1442258560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff25d6d8-cf75-4d64-8441-dc1ddbdf997c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc1d6e5a114665a8b6a42f5e4602d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:47Z,use_quota=True,user_id='0070d0a2a4a844f4a23bc2b3f09005cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Creating volume ff25d6d8-cf75-4d64-8441-dc1ddbdf997c {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:07:46 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:07:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:46 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c 1073741824 Jun 29 03:07:46 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:47 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c 1073741824" returned: 0 in 1.192s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:47 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c Jun 29 03:07:47 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:48 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c" returned: 0 in 0.719s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58ef0846-6519-4c85-8794-58c8b596ac77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7c44f7-71d4-4a1f-9006-f075f2c9a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:48 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Volume volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c (ff25d6d8-cf75-4d64-8441-dc1ddbdf997c): created successfully Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7c44f7-71d4-4a1f-9006-f075f2c9a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Flow 'volume_create_manager' (8ae86734-098b-4da5-8316-9e2923ebc519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:48 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-64e95e16-3958-40ea-a162-b0988645cea4 tempest-VolumesTransfersV355Test-231604160 None] Created volume successfully. Jun 29 03:07:50 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1c5a077d-feb4-41a7-b0ac-61dbcfaab670 tempest-VolumesTransfersV355Test-543861117 None] Transfer volume completed successfully. Jun 29 03:07:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Acquiring lock "cinder-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Acquiring lock "cinder-quobyte-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:07:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-quobyte-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:07:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7873d89c-57f7-45ca-816b-65440f685634]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:52 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c Jun 29 03:07:52 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:53 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c" returned: 0 in 1.233s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:53 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c Jun 29 03:07:53 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:54 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c" returned: 0 in 1.218s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-quobyte-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c" released by "delete_volume" :: held 2.505s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=87,cinder:UPDATE=89,cinder:INSERT=26,cinder:DELETE=8 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=102,cinder:SELECT=74,cinder:INSERT=15,cinder:DELETE=5 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Created reservations ['267efa17-a601-4f98-955c-dd34035ebfb7', '2267b63a-c631-4dbe-98ac-23f8f610eb05', '69365161-f023-4bb4-af4a-9563ee8dc28d', '06b624ce-adfe-48e0-916d-3c21e5a65d90'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:54 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:07:54 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1eb435-17d0-4816-b41e-f41fe8e21975]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:55 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:07:55 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:55 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.133s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:55 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:07:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Deleted volume successfully. Jun 29 03:07:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8e3f9d2a-b9a5-4fd6-90ce-1f43d396a779 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-ff25d6d8-cf75-4d64-8441-dc1ddbdf997c-delete_volume" released by "delete_volume" :: held 3.979s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:07:56 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 1.416s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ebff16-7072-4d1b-ab2d-23f3cfd5a6b8]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:56 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:07:56 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Flow 'volume_create_manager' (1d740608-9a72-43fd-b2b8-38bfb5ddef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f78c70-4151-4e2f-823d-57317508ecce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f78c70-4151-4e2f-823d-57317508ecce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-516026654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6906a95f-7f3e-4b00-b6ae-8331904591a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc1d6e5a114665a8b6a42f5e4602d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:57Z,use_quota=True,user_id='0070d0a2a4a844f4a23bc2b3f09005cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eefaac-429a-48b9-99f9-6ee45da84525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83eefaac-429a-48b9-99f9-6ee45da84525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2995ab1-f2db-4cb3-bf09-9d577b1dde43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2995ab1-f2db-4cb3-bf09-9d577b1dde43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6906a95f-7f3e-4b00-b6ae-8331904591a2', 'volume_name': 'volume-6906a95f-7f3e-4b00-b6ae-8331904591a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca1b2bb-7e33-4e10-88b5-78763a96dfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca1b2bb-7e33-4e10-88b5-78763a96dfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ee35c6-d231-499b-8acc-e83c1d6bf56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:07:56 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Volume 6906a95f-7f3e-4b00-b6ae-8331904591a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6906a95f-7f3e-4b00-b6ae-8331904591a2', 'volume_size': 1} Jun 29 03:07:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:07:57 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jun 29 03:07:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 1.097s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:07:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.3bdff4db-15f9-43ab-baf9-874fbb8652bc58or9265.img {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:07:57 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.3bdff4db-15f9-43ab-baf9-874fbb8652bc58or9265.img Jun 29 03:07:57 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:03 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.3bdff4db-15f9-43ab-baf9-874fbb8652bc58or9265.img" returned: 0 in 6.228s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:03 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c437ebfd-3aa5-482e-a0ee-15a088288e26]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:03 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:08:03 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:04 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 1.104s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:04 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8, size 1024.00 MB, duration 6.23 sec, destination /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.3bdff4db-15f9-43ab-baf9-874fbb8652bc58or9265.img {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:08:04 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Converted 1024.00 MB image at 164.38 MB/s Jun 29 03:08:04 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] 3bdff4db-15f9-43ab-baf9-874fbb8652bc was raw, no need to convert to raw {{(pid=93518) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Flow 'volume_create_manager' (61e6daf7-a99e-464b-87b7-a746af841f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ef4e35-3093-459b-bb33-4b19ff3855cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40ef4e35-3093-459b-bb33-4b19ff3855cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1824509564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343bbe43-8369-4217-9369-8ae0a945fd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2175e880e6c74d738a2b366960d6da0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:06Z,use_quota=True,user_id='81caa3e091d54db68ef696bd6b729932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ec8ef2-db6b-4f7b-b748-1c9f3be35f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ec8ef2-db6b-4f7b-b748-1c9f3be35f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ae0681-db13-4415-bf5e-8353d6fc5355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ae0681-db13-4415-bf5e-8353d6fc5355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343bbe43-8369-4217-9369-8ae0a945fd22', 'volume_name': 'volume-343bbe43-8369-4217-9369-8ae0a945fd22', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d1be0f-b7c9-4146-807c-bc0e1866983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d1be0f-b7c9-4146-807c-bc0e1866983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e00400-a083-47e2-8abe-1378b4b6b6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Volume 343bbe43-8369-4217-9369-8ae0a945fd22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343bbe43-8369-4217-9369-8ae0a945fd22', 'volume_size': 1} Jun 29 03:08:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:16 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:08:16 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=8,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:17 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:08:17 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:18 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.850s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:08:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:08:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:08:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.259s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Uploaded volume to glance image-id: 3bdff4db-15f9-43ab-baf9-874fbb8652bc. {{(pid=93518) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.302s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-516026654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6906a95f-7f3e-4b00-b6ae-8331904591a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9bc1d6e5a114665a8b6a42f5e4602d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:07:57Z,use_quota=True,user_id='0070d0a2a4a844f4a23bc2b3f09005cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Creating volume 6906a95f-7f3e-4b00-b6ae-8331904591a2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:08:26 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:26 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 1073741824 Jun 29 03:08:26 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-37da0217-507f-4061-aff8-24c4a1465396 tempest-VolumesActionsTest-2053694634 None] Copy volume to image completed successfully. Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Acquiring lock "cinder-e853a469-77fc-4550-b7db-b06081eed7fe-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "cinder-e853a469-77fc-4550-b7db-b06081eed7fe-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Acquiring lock "cinder-quobyte-e853a469-77fc-4550-b7db-b06081eed7fe" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "cinder-quobyte-e853a469-77fc-4550-b7db-b06081eed7fe" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[74418ffd-62d1-49ac-9c0d-7571cca1575d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:26 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe Jun 29 03:08:26 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:27 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe" returned: 0 in 0.809s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:27 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 1073741824" returned: 0 in 1.022s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:27 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe Jun 29 03:08:27 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:27 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 Jun 29 03:08:27 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:27 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e853a469-77fc-4550-b7db-b06081eed7fe" returned: 0 in 0.665s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "cinder-quobyte-e853a469-77fc-4550-b7db-b06081eed7fe" released by "delete_volume" :: held 1.531s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Created reservations ['35bd6fa5-c6d0-4e71-afd3-9fb75b41cbf6', 'e1fe161d-b485-4e6f-b4f9-1d86fac214db', 'bfd8d3c0-8c82-4140-bd42-81d68b43da0c', 'a4481e71-3451-4c65-96de-f7cf70d379fd'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:08:27 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2" returned: 0 in 0.716s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.434s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1824509564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=343bbe43-8369-4217-9369-8ae0a945fd22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2175e880e6c74d738a2b366960d6da0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:06Z,use_quota=True,user_id='81caa3e091d54db68ef696bd6b729932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Creating volume 343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:08:27 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:27 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 1073741824 Jun 29 03:08:27 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ee35c6-d231-499b-8acc-e83c1d6bf56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6906a95f-7f3e-4b00-b6ae-8331904591a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965efe53-6314-45a6-a5f3-ded91e02a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:27 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:08:27 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:28 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Volume volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 (6906a95f-7f3e-4b00-b6ae-8331904591a2): created successfully Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965efe53-6314-45a6-a5f3-ded91e02a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Flow 'volume_create_manager' (1d740608-9a72-43fd-b2b8-38bfb5ddef4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-156d4891-c15b-4604-a0a2-a992f0e8c8da tempest-VolumesTransfersV355Test-231604160 None] Created volume successfully. Jun 29 03:08:28 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.672s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:08:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Deleted volume successfully. Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2c7e7b0a-c857-410c-b1c4-da4b06bbd325 tempest-AttachVolumeShelveTestJSON-339706289 None] Lock "cinder-e853a469-77fc-4550-b7db-b06081eed7fe-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Acquiring lock "cinder-6906a95f-7f3e-4b00-b6ae-8331904591a2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-6906a95f-7f3e-4b00-b6ae-8331904591a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Acquiring lock "cinder-quobyte-6906a95f-7f3e-4b00-b6ae-8331904591a2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-quobyte-6906a95f-7f3e-4b00-b6ae-8331904591a2" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9d03f2-4dcf-4020-9cf6-2069ba3468da]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:28 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 Jun 29 03:08:28 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:28 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 1073741824" returned: 0 in 1.025s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:29 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 Jun 29 03:08:29 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:29 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:29 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2 Jun 29 03:08:29 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:29 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22" returned: 0 in 0.799s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.497s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e00400-a083-47e2-8abe-1378b4b6b6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343bbe43-8369-4217-9369-8ae0a945fd22', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db35737-9f16-4214-b216-04c4b6b6491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d2aeb-6c5c-463f-b1ca-97d9d743468a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:29 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Volume volume-343bbe43-8369-4217-9369-8ae0a945fd22 (343bbe43-8369-4217-9369-8ae0a945fd22): created successfully Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db35737-9f16-4214-b216-04c4b6b6491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Flow 'volume_create_manager' (61e6daf7-a99e-464b-87b7-a746af841f07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-730459e3-6e80-44c8-8288-c8db0320688a tempest-VolumesDeleteCascade-306481324 None] Created volume successfully. Jun 29 03:08:30 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:08:30 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:30 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6906a95f-7f3e-4b00-b6ae-8331904591a2" returned: 0 in 0.737s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-quobyte-6906a95f-7f3e-4b00-b6ae-8331904591a2" released by "delete_volume" :: held 1.638s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Created reservations ['327416b8-5866-468f-a973-7ded32829500', 'a8e4e8fa-8412-441f-aa2a-c1deef7e2cdc', 'b23fc34c-5700-4456-9afa-036ada180aef', 'ddace8f6-9b1a-4729-ae1f-289729640666'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:30 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:08:30 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:30 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 0.873s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798fff6-8847-47f8-88b0-f19a3dc4d9fb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:30 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:08:30 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:31 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.847s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:31 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:08:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Deleted volume successfully. Jun 29 03:08:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f01079c9-ddf4-4dc1-a3bb-be21c9c73f95 tempest-VolumesTransfersV355Test-2057951961 None] Lock "cinder-6906a95f-7f3e-4b00-b6ae-8331904591a2-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:31 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 1.089s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:31 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img Jun 29 03:08:31 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:38 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img" returned: 0 in 6.316s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daddbb3-58c6-4d2c-8150-42a34a78464c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:38 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:08:38 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:39 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 1.051s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:39 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:08:39 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Converted 1024.00 MB image at 162.10 MB/s Jun 29 03:08:39 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] c8b20cc1-2834-4fa6-ab35-9866238817bb was raw, converting to qcow2 {{(pid=93518) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 29 03:08:39 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[31568371-acdc-4619-9a8b-14aaa5e38a66]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:39 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img Jun 29 03:08:39 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:40 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img" returned: 0 in 0.897s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:40 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img Jun 29 03:08:40 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:40 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img" returned: 1 in 0.750s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:08:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:40 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g Jun 29 03:08:40 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:41 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=12,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:08:41 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g" returned: 0 in 0.728s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:41 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Image conversion details: src /opt/stack/data/cinder/conversion/e20f9aa9-4c69-4da8-900b-03d74a32f8f8.temp_image.c8b20cc1-2834-4fa6-ab35-9866238817bbb67ngp5d.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:08:41 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 29 03:08:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e4f6a5-b5b2-4495-839d-57c9f6c3e723]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:41 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g Jun 29 03:08:41 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:42 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_jnl48u3g" returned: 0 in 0.904s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Flow 'volume_create_manager' (5d27108c-922e-4620-9d5c-221df144cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc06461-1c82-40ab-9e16-850fc611b1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc06461-1c82-40ab-9e16-850fc611b1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1225838122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059b5242-d4c3-4628-ae39-66dd91c20b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6203d91a3a46cd8d2e17893a7dfbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:43Z,use_quota=True,user_id='76d096d4806149028c25e743a7bc7006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07318b0-3482-46a4-8d9c-1441758f6db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f07318b0-3482-46a4-8d9c-1441758f6db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce568ab-d0f3-4afc-a072-1edf53c3e372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce568ab-d0f3-4afc-a072-1edf53c3e372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059b5242-d4c3-4628-ae39-66dd91c20b10', 'volume_name': 'volume-059b5242-d4c3-4628-ae39-66dd91c20b10', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3a19bd-92a0-4f41-bcb3-13abd71ed66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da3a19bd-92a0-4f41-bcb3-13abd71ed66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81575848-a32b-4620-93b0-35f935018dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:43 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Volume 059b5242-d4c3-4628-ae39-66dd91c20b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059b5242-d4c3-4628-ae39-66dd91c20b10', 'volume_size': 1} Jun 29 03:08:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.531s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Uploaded volume to glance image-id: c8b20cc1-2834-4fa6-ab35-9866238817bb. {{(pid=93518) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 29 03:08:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.838s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Creating offline snapshot 63c08871-42d0-46ec-bd53-3f01a151afb3 of volume 343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:08:44 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5d8e84cf-3a63-4982-8802-75c9743bb3dc tempest-VolumesActionsTest-2053694634 None] Copy volume to image completed successfully. Jun 29 03:08:44 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c7a74b-25c1-4a72-86ae-06c26dd61671]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:44 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 Jun 29 03:08:44 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:45 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22" returned: 0 in 0.752s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:45 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 1G Jun 29 03:08:45 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:46 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 1G" returned: 0 in 0.929s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343bbe43-8369-4217-9369-8ae0a945fd22 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:46 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343bbe43-8369-4217-9369-8ae0a945fd22 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:08:46 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "cinder-quobyte-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-quobyte-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f378ee-73a0-42da-ab0a-1ee62a745fd4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:46 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:08:46 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:46 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343bbe43-8369-4217-9369-8ae0a945fd22 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:46 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 is being set with open permissions: ugo+rw Jun 29 03:08:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:46 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:08:46 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:47 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 0.877s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:47 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8 Jun 29 03:08:47 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:47 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:47 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info Jun 29 03:08:47 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:47 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" returned: 0 in 0.713s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-quobyte-e20f9aa9-4c69-4da8-900b-03d74a32f8f8" released by "delete_volume" :: held 1.662s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:47 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Created reservations ['441d4431-c60c-4480-90a4-12e52fa36bb4', '5176f466-cc8b-4081-bd04-90db602cbe08', '4bd4c8fd-0e20-47f4-a404-2cbe33c8fae1', '6f137dea-d29c-4976-a117-ec31220d8df2'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:48 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:08:48 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:48 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info" returned: 0 in 0.786s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:48 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info is being set with open permissions: ugo+rw Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:48 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info Jun 29 03:08:48 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.835s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:48 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:08:48 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:48 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Deleted volume successfully. Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a092c3-dace-48c9-8dd8-ec2bbed43868 tempest-VolumesActionsTest-2053694634 None] Lock "cinder-e20f9aa9-4c69-4da8-900b-03d74a32f8f8-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:49 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.info" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.945s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.825s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1225838122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059b5242-d4c3-4628-ae39-66dd91c20b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6203d91a3a46cd8d2e17893a7dfbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:43Z,use_quota=True,user_id='76d096d4806149028c25e743a7bc7006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Creating volume 059b5242-d4c3-4628-ae39-66dd91c20b10 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:08:49 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:49 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 1073741824 Jun 29 03:08:49 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4288349e-46a8-49af-b8bf-c51b12f49803 tempest-VolumesDeleteCascade-306481324 None] Create snapshot completed successfully Jun 29 03:08:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:50 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 1073741824" returned: 0 in 1.123s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:50 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 Jun 29 03:08:50 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:51 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10" returned: 0 in 0.781s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.401s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Creating offline snapshot 12ca9495-7900-4753-877d-cf4c94a10e1b of volume 343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81575848-a32b-4620-93b0-35f935018dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059b5242-d4c3-4628-ae39-66dd91c20b10', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd819208-4c05-42d4-b73d-b1f7f7fc55d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b491d2e7-93cf-425d-bc71-389ee5dacb84]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Volume volume-059b5242-d4c3-4628-ae39-66dd91c20b10 (059b5242-d4c3-4628-ae39-66dd91c20b10): created successfully Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd819208-4c05-42d4-b73d-b1f7f7fc55d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Flow 'volume_create_manager' (5d27108c-922e-4620-9d5c-221df144cce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:51 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e1688c1b-42f6-4c53-9208-39fb87a22ea3 tempest-VolumesTransfersV357Test-462589388 None] Created volume successfully. Jun 29 03:08:51 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:08:51 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:52 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 0.939s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343bbe43-8369-4217-9369-8ae0a945fd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:08:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:52 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b 1G Jun 29 03:08:52 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0ff7980c-b856-47b5-a88d-2f05133d98ff tempest-VolumesTransfersV357Test-1710988550 None] Transfer volume completed successfully. Jun 29 03:08:53 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b 1G" returned: 0 in 1.201s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:53 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b Jun 29 03:08:53 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Acquiring lock "cinder-059b5242-d4c3-4628-ae39-66dd91c20b10-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-059b5242-d4c3-4628-ae39-66dd91c20b10-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Acquiring lock "cinder-quobyte-059b5242-d4c3-4628-ae39-66dd91c20b10" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-quobyte-059b5242-d4c3-4628-ae39-66dd91c20b10" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:54 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b" returned: 0 in 1.019s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:54 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b is being set with open permissions: ugo+rw Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ce2ff-ab47-4814-be27-75ba90d04f1c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:54 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b Jun 29 03:08:54 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:54 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 Jun 29 03:08:54 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:55 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b" returned: 0 in 0.869s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a73b71ca-4b84-4530-9d81-68768c8495db tempest-VolumesDeleteCascade-306481324 None] Create snapshot completed successfully Jun 29 03:08:55 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10" returned: 0 in 1.016s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:55 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10 Jun 29 03:08:55 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:56 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-059b5242-d4c3-4628-ae39-66dd91c20b10" returned: 0 in 0.692s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-quobyte-059b5242-d4c3-4628-ae39-66dd91c20b10" released by "delete_volume" :: held 1.788s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-343bbe43-8369-4217-9369-8ae0a945fd22-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-343bbe43-8369-4217-9369-8ae0a945fd22-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Performing cascade delete. {{(pid=93518) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Created reservations ['26d6c27f-e311-4981-813e-cad71e4863c0', '3bcc9bf7-7d5c-4a5b-a027-bd2f98c1582f', 'be8afde5-4ad9-4012-95dd-8d62ac5bcd08', '5b12ee70-d211-4b4f-ac86-79096d5c2ca1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-12ca9495-7900-4753-877d-cf4c94a10e1b-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-12ca9495-7900-4753-877d-cf4c94a10e1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-12ca9495-7900-4753-877d-cf4c94a10e1b" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-12ca9495-7900-4753-877d-cf4c94a10e1b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Deleting offline snapshot 12ca9495-7900-4753-877d-cf4c94a10e1b of volume 343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] snapshot_file for this snap is: volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5921b9-c642-48ab-b6d3-9a8d3787a4d8]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:56 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:08:56 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:56 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b Jun 29 03:08:56 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Flow 'volume_create_manager' (25e40a29-8b2d-461d-a41a-489ff22e946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1ecb1e-aa87-455e-aa10-c6f1f60e5a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1ecb1e-aa87-455e-aa10-c6f1f60e5a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1688399825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7618d9d-e4af-44f3-afdb-7e355c871222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6203d91a3a46cd8d2e17893a7dfbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:57Z,use_quota=True,user_id='76d096d4806149028c25e743a7bc7006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d2a318-a6ba-4d8d-920e-0868c01c3f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d2a318-a6ba-4d8d-920e-0868c01c3f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35eb3932-6f9b-4ab3-80be-6ded056f1205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35eb3932-6f9b-4ab3-80be-6ded056f1205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7618d9d-e4af-44f3-afdb-7e355c871222', 'volume_name': 'volume-a7618d9d-e4af-44f3-afdb-7e355c871222', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb3c049-26cc-4d1a-af10-38a5dbd37e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb3c049-26cc-4d1a-af10-38a5dbd37e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c923d-669b-4191-85db-59f10892e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Volume a7618d9d-e4af-44f3-afdb-7e355c871222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7618d9d-e4af-44f3-afdb-7e355c871222', 'volume_size': 1} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1688399825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7618d9d-e4af-44f3-afdb-7e355c871222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6203d91a3a46cd8d2e17893a7dfbce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:57Z,use_quota=True,user_id='76d096d4806149028c25e743a7bc7006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Creating volume a7618d9d-e4af-44f3-afdb-7e355c871222 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:08:57 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:57 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 1073741824 Jun 29 03:08:57 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:57 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.960s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:08:57 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Deleted volume successfully. Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b" returned: 0 in 0.973s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343bbe43-8369-4217-9369-8ae0a945fd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-879802fb-5ed1-4b6a-9e59-3ce84d238034 tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-059b5242-d4c3-4628-ae39-66dd91c20b10-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Flow 'volume_create_manager' (cbdb9824-a4b4-4545-b06e-6ebd7060a044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2aa06d-4bad-4779-b8c8-d0b15c9b7fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8fa10e-a8c3-473a-a8a3-e0ac72f35a3b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e2aa06d-4bad-4779-b8c8-d0b15c9b7fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1510608005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e919a70-4af1-4a9b-bd85-bf3f94fcb507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332d75e3350b45d69256598ce638d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:57Z,use_quota=True,user_id='fe968b64d1f44bc0ab9c59f9ad9c9d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ea0b02-3f35-42b2-94ff-0dc754d02afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ea0b02-3f35-42b2-94ff-0dc754d02afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4b8a9c-f09c-409a-8607-9276d9984d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4b8a9c-f09c-409a-8607-9276d9984d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e919a70-4af1-4a9b-bd85-bf3f94fcb507', 'volume_name': 'volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a43cf9d-349c-4a3b-893d-5ee4b575f1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a43cf9d-349c-4a3b-893d-5ee4b575f1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16799ba-9840-4676-81d2-917d6f188ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507', 'volume_size': 1} Jun 29 03:08:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:57 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:08:57 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:58 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 1073741824" returned: 0 in 0.894s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:58 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 Jun 29 03:08:58 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:58 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 0.800s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343bbe43-8369-4217-9369-8ae0a945fd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:08:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:58 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b Jun 29 03:08:58 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:59 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222" returned: 0 in 0.673s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.340s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1510608005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e919a70-4af1-4a9b-bd85-bf3f94fcb507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='332d75e3350b45d69256598ce638d864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:08:57Z,use_quota=True,user_id='fe968b64d1f44bc0ab9c59f9ad9c9d3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Creating volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:08:59 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:59 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 1073741824 Jun 29 03:08:59 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c923d-669b-4191-85db-59f10892e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7618d9d-e4af-44f3-afdb-7e355c871222', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0916d513-8aa6-4341-8dcc-80b776902679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:08:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Volume volume-a7618d9d-e4af-44f3-afdb-7e355c871222 (a7618d9d-e4af-44f3-afdb-7e355c871222): created successfully Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0916d513-8aa6-4341-8dcc-80b776902679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Flow 'volume_create_manager' (25e40a29-8b2d-461d-a41a-489ff22e946a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:08:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-db82d378-b75e-4786-ad0d-6ead0fb82168 tempest-VolumesTransfersV357Test-462589388 None] Created volume successfully. Jun 29 03:08:59 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b" returned: 0 in 0.951s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:08:59 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b Jun 29 03:08:59 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Acquiring lock "cinder-a7618d9d-e4af-44f3-afdb-7e355c871222-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-a7618d9d-e4af-44f3-afdb-7e355c871222-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Acquiring lock "cinder-quobyte-a7618d9d-e4af-44f3-afdb-7e355c871222" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:08:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-quobyte-a7618d9d-e4af-44f3-afdb-7e355c871222" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796c7e4-912e-496c-a93a-9357595d81d4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:00 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 Jun 29 03:09:00 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:00 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.12ca9495-7900-4753-877d-cf4c94a10e1b" returned: 0 in 1.003s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:00 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 1073741824" returned: 0 in 1.370s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-12ca9495-7900-4753-877d-cf4c94a10e1b" released by "_delete_snapshot" :: held 3.934s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" released by "delete_snapshot" :: held 3.988s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:00 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 Jun 29 03:09:00 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Created reservations ['cae91067-5cd1-4e6e-84b5-b90626754226', '9dbefce7-c328-458a-aa9e-d4aa1bf71101', '13aaf323-e93e-4ffb-b923-00b962efc357', 'bd410382-1d3d-46e6-904a-6710b4f92fb9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Delete snapshot completed successfully. Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-12ca9495-7900-4753-877d-cf4c94a10e1b-delete_snapshot" released by "delete_snapshot" :: held 4.232s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-63c08871-42d0-46ec-bd53-3f01a151afb3-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-63c08871-42d0-46ec-bd53-3f01a151afb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-63c08871-42d0-46ec-bd53-3f01a151afb3" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-63c08871-42d0-46ec-bd53-3f01a151afb3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Deleting offline snapshot 63c08871-42d0-46ec-bd53-3f01a151afb3 of volume 343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] snapshot_file for this snap is: volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d616b114-0ae0-4c05-bbea-32d5489ca41e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:01 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:09:01 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:01 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222" returned: 0 in 1.172s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:01 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222 Jun 29 03:09:01 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:01 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" returned: 0 in 0.973s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] <== create_volume: return (2403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16799ba-9840-4676-81d2-917d6f188ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff8feae-7508-43a2-89a5-74c6a522bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:01 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Volume volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 (8e919a70-4af1-4a9b-bd85-bf3f94fcb507): created successfully Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff8feae-7508-43a2-89a5-74c6a522bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Flow 'volume_create_manager' (cbdb9824-a4b4-4545-b06e-6ebd7060a044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f0428b62-83c5-4662-a1f2-b27388cb98b9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Created volume successfully. Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Creating offline snapshot bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 of volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:09:02 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7618d9d-e4af-44f3-afdb-7e355c871222" returned: 0 in 0.820s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa8ac80-7b3d-43f8-bd1f-8aca8774bced]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-quobyte-a7618d9d-e4af-44f3-afdb-7e355c871222" released by "delete_volume" :: held 2.059s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:02 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 1.247s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-343bbe43-8369-4217-9369-8ae0a945fd22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b2097-5ad2-444b-9e6a-cf7733d4500b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Created reservations ['6c047ab2-093f-4cff-9a14-b8e4499f6c32', 'ece71b92-f7c5-4864-b98d-e27b94e548d0', '24029c11-2840-4216-87f3-98f7eb59f8d4', 'a9e27a9a-950e-4db1-8dcf-c15b5bd143bf'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:02 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 Jun 29 03:09:02 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:02 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:02 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:02 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 Jun 29 03:09:02 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:03 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" returned: 0 in 1.146s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:03 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.961s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Deleted volume successfully. Jun 29 03:09:03 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 1G Jun 29 03:09:03 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-570b0b31-1031-4313-90c8-e1b323009bae tempest-VolumesTransfersV357Test-1742578086 None] Lock "cinder-a7618d9d-e4af-44f3-afdb-7e355c871222-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:03 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22" returned: 0 in 1.160s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:03 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:09:03 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:04 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 1.056s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:04 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 1G" returned: 0 in 1.189s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:04 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3 Jun 29 03:09:04 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:04 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:04 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:05 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22.63c08871-42d0-46ec-bd53-3f01a151afb3" returned: 0 in 0.796s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-63c08871-42d0-46ec-bd53-3f01a151afb3" released by "_delete_snapshot" :: held 4.397s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" released by "delete_snapshot" :: held 4.431s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:05 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:05 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 is being set with open permissions: ugo+rw Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:05 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:05 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Created reservations ['9f9bf86e-46ac-4388-8b9b-604705ba076b', '50cf8584-3e62-413d-85f6-c10c56cb1d6f', '04bbd982-3515-47b2-959c-8ecffaab0653', '03ff3da5-239b-4b25-a3a4-eb11dcd49000'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Delete snapshot completed successfully. Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-63c08871-42d0-46ec-bd53-3f01a151afb3-delete_snapshot" released by "delete_snapshot" :: held 4.665s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Snapshots deleted, issuing volume delete {{(pid=93518) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d223c7e-0ded-4793-a5b9-ad2651d4e553]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:05 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 Jun 29 03:09:05 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:05 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:06 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info Jun 29 03:09:06 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:06 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22" returned: 0 in 0.940s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:06 devstack sudo[102414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22 Jun 29 03:09:06 devstack sudo[102414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:06 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info" returned: 0 in 0.799s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:06 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info is being set with open permissions: ugo+rw Jun 29 03:09:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:06 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info Jun 29 03:09:06 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:07 devstack sudo[102414]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-343bbe43-8369-4217-9369-8ae0a945fd22" returned: 0 in 0.758s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-343bbe43-8369-4217-9369-8ae0a945fd22" released by "delete_volume" :: held 1.771s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Created reservations ['b766044a-9e0c-404b-b8d4-3257a1be5729', '4903a1ab-3086-4891-a1bf-65e86e034111', 'da53d0ee-4aef-4cb6-a64d-d95bc5989c8a', '69c9055c-2d5c-4c6b-bb50-9df625b2bad1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:07 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:07 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:07 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.info" returned: 0 in 1.004s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.916s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1e97a4c1-914d-4477-a6c9-944cfbecce70 tempest-VolumesSnapshotListTestJSON-1457527086 None] Create snapshot completed successfully Jun 29 03:09:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:08 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Creating offline snapshot 68a6eb43-62f7-4213-b245-b77e865fd66f of volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.507s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Deleted volume successfully. Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[608d1bd5-2bc7-41af-8bf0-72b693b9e86e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-45ca0d0f-b1af-4027-a1d9-9b731745c4db tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-343bbe43-8369-4217-9369-8ae0a945fd22-delete_volume" released by "delete_volume" :: held 12.760s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:09 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:09 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Flow 'volume_create_manager' (37638eba-1d0b-42ca-9088-8cea5245ac00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c337464-6382-42ef-8b66-8c8ac6de15d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c337464-6382-42ef-8b66-8c8ac6de15d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-881258432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13750404-429d-4b31-9901-5f0d6eb98ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2175e880e6c74d738a2b366960d6da0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:10Z,use_quota=True,user_id='81caa3e091d54db68ef696bd6b729932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668c3002-96b4-4ed2-a2df-4d0360b7408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668c3002-96b4-4ed2-a2df-4d0360b7408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f2913-38cd-4e11-a953-76c391c54a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6f2913-38cd-4e11-a953-76c391c54a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13750404-429d-4b31-9901-5f0d6eb98ee9', 'volume_name': 'volume-13750404-429d-4b31-9901-5f0d6eb98ee9', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26915c8d-bf2a-4256-9a98-0e543a29cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26915c8d-bf2a-4256-9a98-0e543a29cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36ecbe2-7fce-4e34-9216-e346220d2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:09 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Volume 13750404-429d-4b31-9901-5f0d6eb98ee9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13750404-429d-4b31-9901-5f0d6eb98ee9', 'volume_size': 1} Jun 29 03:09:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:10 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 1.120s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:10 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f 1G Jun 29 03:09:10 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Flow 'volume_create_manager' (b2a05946-763c-4a3a-ba28-78ade822d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981c5689-1643-4423-99cc-1643fc182dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981c5689-1643-4423-99cc-1643fc182dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1142760115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cb5a10-d580-4977-9d13-7195f6b3e715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d8717f2d2943bc8361d44a2fe9b908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:11Z,use_quota=True,user_id='a9d34feebc90419b90bdfd903c67de7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb5bd48-d6a8-4121-b837-00e2daecc0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fb5bd48-d6a8-4121-b837-00e2daecc0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e3f00e-847d-4f1b-97af-98a719f6e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e3f00e-847d-4f1b-97af-98a719f6e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cb5a10-d580-4977-9d13-7195f6b3e715', 'volume_name': 'volume-72cb5a10-d580-4977-9d13-7195f6b3e715', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90692a44-9c26-4705-84b5-982d5a799769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90692a44-9c26-4705-84b5-982d5a799769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b535cd1-8527-4d3f-b963-2ff4fc175e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:10 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Volume 72cb5a10-d580-4977-9d13-7195f6b3e715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cb5a10-d580-4977-9d13-7195f6b3e715', 'volume_size': 1} Jun 29 03:09:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:11 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f 1G" returned: 0 in 1.069s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:11 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:11 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:11 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.758s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:11 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f is being set with open permissions: ugo+rw Jun 29 03:09:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:12 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:12 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:12 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.708s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.823s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.931s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-881258432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13750404-429d-4b31-9901-5f0d6eb98ee9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2175e880e6c74d738a2b366960d6da0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:10Z,use_quota=True,user_id='81caa3e091d54db68ef696bd6b729932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Creating volume 13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:09:12 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:09:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:12 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 1073741824 Jun 29 03:09:12 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-82777577-eb39-4b42-84a0-f73659b015f0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Create snapshot completed successfully Jun 29 03:09:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:13 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 1073741824" returned: 0 in 0.939s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:13 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:13 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:14 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 0.709s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.644s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1142760115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cb5a10-d580-4977-9d13-7195f6b3e715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d8717f2d2943bc8361d44a2fe9b908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:11Z,use_quota=True,user_id='a9d34feebc90419b90bdfd903c67de7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Creating volume 72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:09:14 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36ecbe2-7fce-4e34-9216-e346220d2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13750404-429d-4b31-9901-5f0d6eb98ee9', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:14 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 1073741824 Jun 29 03:09:14 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04428998-27c1-4dda-8915-80ac16facc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:14 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Volume volume-13750404-429d-4b31-9901-5f0d6eb98ee9 (13750404-429d-4b31-9901-5f0d6eb98ee9): created successfully Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04428998-27c1-4dda-8915-80ac16facc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Flow 'volume_create_manager' (37638eba-1d0b-42ca-9088-8cea5245ac00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-540dde19-2de6-4a19-8df3-d1357483fa7b tempest-VolumesDeleteCascade-306481324 None] Created volume successfully. Jun 29 03:09:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:15 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 1073741824" returned: 0 in 0.937s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:15 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:15 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:16 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 0.679s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.812s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Creating offline snapshot f3705ef6-b885-4197-bc62-2195b2f1c57c of volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b535cd1-8527-4d3f-b963-2ff4fc175e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cb5a10-d580-4977-9d13-7195f6b3e715', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467973b7-6f91-4cc2-b0a1-e3c675b2e364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b9fb2-3c05-4b1b-bb37-a38b68928816]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:16 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Volume volume-72cb5a10-d580-4977-9d13-7195f6b3e715 (72cb5a10-d580-4977-9d13-7195f6b3e715): created successfully Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467973b7-6f91-4cc2-b0a1-e3c675b2e364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Flow 'volume_create_manager' (b2a05946-763c-4a3a-ba28-78ade822d336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d98722f8-b4fa-4525-8e16-91f6a2e28605 tempest-VolumesCloneTest-1068544946 None] Created volume successfully. Jun 29 03:09:16 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:16 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:17 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.882s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:17 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c 1G Jun 29 03:09:17 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:17 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=85,cinder:SELECT=69,cinder:INSERT=24,cinder:DELETE=8 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:09:17 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Flow 'volume_create_manager' (6a8a66f1-97ec-4b16-a6cf-60d107108678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a75720-766c-42dc-acf8-88da1e9652ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a75720-766c-42dc-acf8-88da1e9652ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1467649200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0d8879-b4fa-43d0-a928-a87a2b20b5a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d8717f2d2943bc8361d44a2fe9b908',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=72cb5a10-d580-4977-9d13-7195f6b3e715,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:18Z,use_quota=True,user_id='a9d34feebc90419b90bdfd903c67de7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50e2a1f-28a1-427c-bc6d-851086f3ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e50e2a1f-28a1-427c-bc6d-851086f3ee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ee7eef-9fa3-49c1-94cd-a4dd67d6e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ee7eef-9fa3-49c1-94cd-a4dd67d6e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0b0d8879-b4fa-43d0-a928-a87a2b20b5a7', 'volume_name': 'volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7', 'volume_size': 2, 'source_volid': '72cb5a10-d580-4977-9d13-7195f6b3e715', 'source_volstatus': 'available'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5549fa63-e43e-4b14-a442-ca769c535bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5549fa63-e43e-4b14-a442-ca769c535bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8d1719-b45a-43d5-a1c3-ff8007d05255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Volume 0b0d8879-b4fa-43d0-a928-a87a2b20b5a7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7', 'volume_size': 2, 'source_volid': '72cb5a10-d580-4977-9d13-7195f6b3e715', 'source_volstatus': 'available'} Jun 29 03:09:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:18 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c 1G" returned: 0 in 1.040s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:18 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c Jun 29 03:09:18 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:18 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:09:18 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c" returned: 0 in 0.720s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:18 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c is being set with open permissions: ugo+rw Jun 29 03:09:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:18 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c Jun 29 03:09:18 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:19 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.450s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.443s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Creating offline snapshot b94d9b32-24d8-4673-946c-db3c7510f6dd of volume 13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:09:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7f58942b-1434-4568-9c35-96c600584d9c tempest-VolumesSnapshotListTestJSON-1457527086 None] Create snapshot completed successfully Jun 29 03:09:19 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb5379-619a-4269-95a8-b0d3e3a30ab6]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:19 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:19 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:20 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 0.825s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:20 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd 1G Jun 29 03:09:20 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:21 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd 1G" returned: 0 in 0.867s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13750404-429d-4b31-9901-5f0d6eb98ee9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:21 devstack sudo[102602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13750404-429d-4b31-9901-5f0d6eb98ee9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd Jun 29 03:09:21 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-f3705ef6-b885-4197-bc62-2195b2f1c57c-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-f3705ef6-b885-4197-bc62-2195b2f1c57c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-f3705ef6-b885-4197-bc62-2195b2f1c57c" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-f3705ef6-b885-4197-bc62-2195b2f1c57c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Deleting offline snapshot f3705ef6-b885-4197-bc62-2195b2f1c57c of volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] snapshot_file for this snap is: volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4e6580-c3e5-43f4-9fe1-7a7a37e3a5cb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:21 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c Jun 29 03:09:21 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:22 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13750404-429d-4b31-9901-5f0d6eb98ee9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd" returned: 0 in 0.698s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:22 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd is being set with open permissions: ugo+rw Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:22 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd Jun 29 03:09:22 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:22 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c" returned: 0 in 0.829s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7dd248-c082-4997-9cbe-dda8d3e9df68]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:22 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:22 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:22 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd" returned: 0 in 0.664s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:22 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info Jun 29 03:09:22 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:23 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.782s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:23 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c Jun 29 03:09:23 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:23 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info" returned: 0 in 0.680s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:23 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info is being set with open permissions: ugo+rw Jun 29 03:09:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:23 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info Jun 29 03:09:23 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:24 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.info" returned: 0 in 0.652s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.497s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.275s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:24 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Cloning volume 72cb5a10-d580-4977-9d13-7195f6b3e715 to volume 0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 Jun 29 03:09:24 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f79e879a-dd9f-4d44-a0e1-ef79e5912f02 tempest-VolumesDeleteCascade-306481324 None] Create snapshot completed successfully Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Creating offline snapshot 7b3a2e5e-79e7-4f09-8cc6-e250af32367d of volume 72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[deecdd99-7b08-49a4-a367-5c9a97fdcfeb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:24 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c" returned: 0 in 0.878s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:24 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c Jun 29 03:09:24 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:24 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:24 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:24 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.f3705ef6-b885-4197-bc62-2195b2f1c57c" returned: 0 in 0.702s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:24 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 0.794s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-f3705ef6-b885-4197-bc62-2195b2f1c57c" released by "_delete_snapshot" :: held 3.317s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" released by "delete_snapshot" :: held 3.346s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:25 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d 1G Jun 29 03:09:25 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Created reservations ['adc12a8f-b4a5-4dcd-8a4d-f1bf5c10279b', '0e883356-12b3-436a-9a7f-6bedfdde3da7', '99554703-c646-419f-82de-cdff5fa14072', '0d781b1a-d9b2-47dc-b61d-9c8142b7569f'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:25 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Delete snapshot completed successfully. Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81c1bfd7-ee6e-4fdf-b469-e65d2f9ddcc0 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-f3705ef6-b885-4197-bc62-2195b2f1c57c-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Flow 'volume_create_manager' (27168a94-618a-4db9-a467-e2b2f9b7521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476ef9d5-946c-427f-aa2e-eec4a98f3603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (476ef9d5-946c-427f-aa2e-eec4a98f3603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-898951554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2175e880e6c74d738a2b366960d6da0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b94d9b32-24d8-4673-946c-db3c7510f6dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:25Z,use_quota=True,user_id='81caa3e091d54db68ef696bd6b729932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b307e8-4ff8-48c7-b133-000d2ae50384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b307e8-4ff8-48c7-b133-000d2ae50384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1157a3-9fd9-45bd-aec8-c908b0f0b9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1157a3-9fd9-45bd-aec8-c908b0f0b9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3', 'volume_name': 'volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3', 'volume_size': 1, 'snapshot_id': 'b94d9b32-24d8-4673-946c-db3c7510f6dd'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bba633-adb8-4c84-b6d5-c6768ba845d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4bba633-adb8-4c84-b6d5-c6768ba845d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3c8ec8-949c-4294-bb5e-c9bb66121966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Volume fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3', 'volume_size': 1, 'snapshot_id': 'b94d9b32-24d8-4673-946c-db3c7510f6dd'} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:25 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d 1G" returned: 0 in 0.822s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72cb5a10-d580-4977-9d13-7195f6b3e715 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-68a6eb43-62f7-4213-b245-b77e865fd66f-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:25 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72cb5a10-d580-4977-9d13-7195f6b3e715 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d Jun 29 03:09:25 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-68a6eb43-62f7-4213-b245-b77e865fd66f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-68a6eb43-62f7-4213-b245-b77e865fd66f" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-68a6eb43-62f7-4213-b245-b77e865fd66f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Deleting offline snapshot 68a6eb43-62f7-4213-b245-b77e865fd66f of volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] snapshot_file for this snap is: volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53113f4-fdd4-49fd-909f-259b4fdfe5b2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:26 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:26 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:26 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72cb5a10-d580-4977-9d13-7195f6b3e715 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d" returned: 0 in 0.688s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:26 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d is being set with open permissions: ugo+rw Jun 29 03:09:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:26 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d Jun 29 03:09:26 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:26 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.766s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ed1a28-e27e-4a4b-8c6d-e3ed483a7e59]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:26 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:26 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:27 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d" returned: 0 in 0.676s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:27 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info Jun 29 03:09:27 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:27 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:27 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:27 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:27 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info" returned: 0 in 0.652s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:27 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info is being set with open permissions: ugo+rw Jun 29 03:09:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:27 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info Jun 29 03:09:27 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:28 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.746s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:28 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f Jun 29 03:09:28 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:28 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.info" returned: 0 in 0.699s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Acquiring lock "cinder-quobyte-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] snapshot: 7b3a2e5e-79e7-4f09-8cc6-e250af32367d, volume: 0b0d8879-b4fa-43d0-a928-a87a2b20b5a7, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71b8d30-030c-416b-adc9-ebddbf493a82]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:28 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d Jun 29 03:09:28 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:28 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.68a6eb43-62f7-4213-b245-b77e865fd66f" returned: 0 in 0.643s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-68a6eb43-62f7-4213-b245-b77e865fd66f" released by "_delete_snapshot" :: held 3.009s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" released by "delete_snapshot" :: held 3.042s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:28 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Created reservations ['f3f6c174-bff3-4905-afa5-1d4a07ffe701', 'b4dcc91d-3639-45a7-8396-bf267d2f1749', 'cf10fecd-b6bb-4512-8bc7-a7da3f89d276', '16d04a87-fac0-4202-81c3-bf08fb7753fd'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Delete snapshot completed successfully. Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b72f51c7-f391-40fd-8964-7ebaae3c9385 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-68a6eb43-62f7-4213-b245-b77e865fd66f-delete_snapshot" released by "delete_snapshot" :: held 3.207s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:29 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d" returned: 0 in 0.835s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72cb5a10-d580-4977-9d13-7195f6b3e715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eac76d-325d-4766-9712-55d15f2adfdb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:29 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:29 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Deleting offline snapshot bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 of volume 8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] snapshot_file for this snap is: volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b80f78-8e1f-4c4c-90c0-9465e83ce2f2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:30 devstack sudo[102697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:30 devstack sudo[102697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:30 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 0.847s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:30 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 Jun 29 03:09:30 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:30 devstack sudo[102697]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2338cdf7-48ed-49bf-a0f7-fec5453eee45]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:31 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 Jun 29 03:09:31 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:32 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" returned: 0 in 1.516s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:32 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:32 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:09:34 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Flow 'volume_create_manager' (726d97c1-04a8-4cf3-941c-4a39b3875aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b79646a-9251-4864-af1c-f209272debf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 1.789s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b79646a-9251-4864-af1c-f209272debf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1955931812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89225fd6-36db-4c36-bae8-b9dc0a0848eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a3980f17ef4e24903e3835c068ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:34Z,use_quota=True,user_id='b2e82153f1444fe78af69e5ff0b3d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:34 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97 Jun 29 03:09:34 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f46c5d-633c-4b37-940f-15c9de53b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f46c5d-633c-4b37-940f-15c9de53b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde6adff-7d59-455e-9d73-cf8e15b5c3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde6adff-7d59-455e-9d73-cf8e15b5c3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89225fd6-36db-4c36-bae8-b9dc0a0848eb', 'volume_name': 'volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f954b-3899-4b83-b0a9-ddece956e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224f954b-3899-4b83-b0a9-ddece956e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03840fb-5580-4ab0-b0e1-0b0e5b6d6b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:34 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Volume 89225fd6-36db-4c36-bae8-b9dc0a0848eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb', 'volume_size': 1} Jun 29 03:09:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:35 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507.bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" returned: 0 in 1.359s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97" released by "_delete_snapshot" :: held 5.586s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" released by "delete_snapshot" :: held 5.626s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:35 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" returned: 0 in 5.393s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc711e7-7480-498b-bce2-645c9cd98801]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Created reservations ['c29bf0f7-bced-453a-80c1-ba1429688823', '633efe8d-9bd1-4268-a61b-7943339763b7', 'c5a91352-2784-4bf9-932b-607af4306adc', '595770bb-a969-46dc-84da-0ab399b0b7a5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Delete snapshot completed successfully. Jun 29 03:09:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-81032f90-c36b-459a-a600-a23922069fca tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-bb70fb77-a05e-42fc-b1a4-86b1c0c1fb97-delete_snapshot" released by "delete_snapshot" :: held 5.801s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:35 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:35 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-8e919a70-4af1-4a9b-bd85-bf3f94fcb507-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-8e919a70-4af1-4a9b-bd85-bf3f94fcb507-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:36 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 1.004s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715, size 1024.00 MB, duration 5.39 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:09:36 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Converted 1024.00 MB image at 189.86 MB/s Jun 29 03:09:36 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 is being set with open permissions: ugo+rw Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:36 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 Jun 29 03:09:36 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7865021-780c-4e7d-abe1-4c1bb6fe47ef]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:36 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 Jun 29 03:09:36 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:37 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" returned: 0 in 0.660s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" released by "_copy_volume_from_snapshot" :: held 8.850s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Acquiring lock "cinder-quobyte-7b3a2e5e-79e7-4f09-8cc6-e250af32367d" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-7b3a2e5e-79e7-4f09-8cc6-e250af32367d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Deleting offline snapshot 7b3a2e5e-79e7-4f09-8cc6-e250af32367d of volume 72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] snapshot_file for this snap is: volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e4b110-d353-449f-9401-d3bb8966f766]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:37 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:37 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d Jun 29 03:09:37 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" returned: 0 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:37 devstack sudo[102787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507 Jun 29 03:09:37 devstack sudo[102787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:38 devstack sudo[102787]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" returned: 0 in 0.644s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:38 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-quobyte-8e919a70-4af1-4a9b-bd85-bf3f94fcb507" released by "delete_volume" :: held 1.487s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d" returned: 0 in 0.789s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72cb5a10-d580-4977-9d13-7195f6b3e715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6559c24-ea64-45b3-bef1-ac35a4625447]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Created reservations ['ad1808b5-ce6a-4965-b619-731e8b004365', '195abda1-3c27-41b6-b744-665af89c74df', '39147ff9-41dc-4518-b442-80e7a7bac447', '89be7e0d-8923-4503-95db-96229c4bae34'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:38 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:38 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:38 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:38 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:39 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.650s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:39 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Deleted volume successfully. Jun 29 03:09:39 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 0.788s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-95fae51b-9481-4e83-8d8b-9cd0c316c1a9 tempest-VolumesSnapshotListTestJSON-1457527086 None] Lock "cinder-8e919a70-4af1-4a9b-bd85-bf3f94fcb507-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:39 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d Jun 29 03:09:39 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:39 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d" returned: 0 in 0.846s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:40 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d Jun 29 03:09:40 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:40 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715.7b3a2e5e-79e7-4f09-8cc6-e250af32367d" returned: 0 in 0.801s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-7b3a2e5e-79e7-4f09-8cc6-e250af32367d" released by "_delete_snapshot" :: held 3.321s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.734s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 15.588s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-b94d9b32-24d8-4673-946c-db3c7510f6dd-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-b94d9b32-24d8-4673-946c-db3c7510f6dd-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Creating volume fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 from snapshot b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8d1719-b45a-43d5-a1c3-ff8007d05255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7', 'volume_size': 2, 'source_volid': '72cb5a10-d580-4977-9d13-7195f6b3e715', 'source_volstatus': 'available'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346ee801-e369-4d86-b242-e0d69c00c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] snapshot: b94d9b32-24d8-4673-946c-db3c7510f6dd, volume: fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:09:40 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Volume volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 (0b0d8879-b4fa-43d0-a928-a87a2b20b5a7): created successfully Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346ee801-e369-4d86-b242-e0d69c00c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Flow 'volume_create_manager' (6a8a66f1-97ec-4b16-a6cf-60d107108678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b9a3b177-cde4-4913-9080-9e30ab57e6dd tempest-VolumesCloneTest-1068544946 None] Created volume successfully. Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f5684f-958e-4734-942b-39a56bacdb25]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:41 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd Jun 29 03:09:41 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "cinder-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=88,cinder:UPDATE=97,cinder:INSERT=26,cinder:DELETE=8 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "cinder-quobyte-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:41 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd" returned: 0 in 0.919s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13750404-429d-4b31-9901-5f0d6eb98ee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc10837c-ea7a-4ed3-9b9e-88b79891548d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[879ffa3b-a4ab-4011-a74b-f300326177d5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:42 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 Jun 29 03:09:42 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:42 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:42 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:42 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" returned: 0 in 0.943s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:42 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 0.941s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:42 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:09:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:42 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7 Jun 29 03:09:42 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:42 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 Jun 29 03:09:42 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:43 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" returned: 0 in 0.689s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7" released by "delete_volume" :: held 1.688s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Created reservations ['d040c17f-89a9-4a0a-832d-e71cccaf8768', 'a77f4d50-2cc4-407c-8dc3-37ae03b961e8', 'a26f09d9-7d05-471c-90ab-388102e1a756', '5209b1ba-d942-4d06-ae7b-7167447bae9d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:43 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:43 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "cinder-72cb5a10-d580-4977-9d13-7195f6b3e715-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-72cb5a10-d580-4977-9d13-7195f6b3e715-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "cinder-quobyte-72cb5a10-d580-4977-9d13-7195f6b3e715" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-72cb5a10-d580-4977-9d13-7195f6b3e715" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:44 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc06b3f-56fb-4a21-8482-5201b55bd0b2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:45 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:45 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:45 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.701s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:45 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:45 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Deleted volume successfully. Jun 29 03:09:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-85ecc4ff-6a01-4b8b-a016-ff4967e37d47 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-0b0d8879-b4fa-43d0-a928-a87a2b20b5a7-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:46 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 1.759s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:46 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715 Jun 29 03:09:46 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:48 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-72cb5a10-d580-4977-9d13-7195f6b3e715" returned: 0 in 2.092s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-quobyte-72cb5a10-d580-4977-9d13-7195f6b3e715" released by "delete_volume" :: held 4.054s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Created reservations ['c765d2ce-99b7-4f3e-b817-f00c42900c5a', '5990cbbe-b525-4c44-9bc2-86326218c2bc', '38bcf9ab-4e2c-4d11-a981-a1eda9e4b263', '2385a8c4-0ce3-4881-b871-720c9ac62101'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:48 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" returned: 0 in 6.065s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc9aa0b-696e-47ef-979b-d07004cc0d55]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:48 devstack sudo[102854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:48 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:49 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:49 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:49 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.754s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:49 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Deleted volume successfully. Jun 29 03:09:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-14edd2ca-2ec6-4658-b67b-270044afaa20 tempest-VolumesCloneTest-1068544946 None] Lock "cinder-72cb5a10-d580-4977-9d13-7195f6b3e715-delete_volume" released by "delete_volume" :: held 5.262s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:50 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 1.395s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:50 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:09:50 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Converted 1024.00 MB image at 168.78 MB/s Jun 29 03:09:50 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 is being set with open permissions: ugo+rw Jun 29 03:09:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:50 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 Jun 29 03:09:50 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:51 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" released by "_copy_volume_from_snapshot" :: held 10.276s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-b94d9b32-24d8-4673-946c-db3c7510f6dd-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" released by "_create_volume_from_snapshot" :: held 10.328s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.354s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.729s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1955931812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89225fd6-36db-4c36-bae8-b9dc0a0848eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a3980f17ef4e24903e3835c068ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:34Z,use_quota=True,user_id='b2e82153f1444fe78af69e5ff0b3d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Creating volume 89225fd6-36db-4c36-bae8-b9dc0a0848eb {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:09:51 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:51 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb 1073741824 Jun 29 03:09:51 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3c8ec8-949c-4294-bb5e-c9bb66121966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3', 'volume_size': 1, 'snapshot_id': 'b94d9b32-24d8-4673-946c-db3c7510f6dd'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc966c0-fb20-40f1-93f5-ab1f0280ad79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Volume volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 (fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3): created successfully Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc966c0-fb20-40f1-93f5-ab1f0280ad79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Flow 'volume_create_manager' (27168a94-618a-4db9-a467-e2b2f9b7521e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:51 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4f03dff6-2fce-4172-9400-ecaddc27920e tempest-VolumesDeleteCascade-306481324 None] Created volume successfully. Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-13750404-429d-4b31-9901-5f0d6eb98ee9-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-13750404-429d-4b31-9901-5f0d6eb98ee9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Performing cascade delete. {{(pid=93518) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-b94d9b32-24d8-4673-946c-db3c7510f6dd-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-b94d9b32-24d8-4673-946c-db3c7510f6dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-13750404-429d-4b31-9901-5f0d6eb98ee9" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-13750404-429d-4b31-9901-5f0d6eb98ee9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-b94d9b32-24d8-4673-946c-db3c7510f6dd" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-b94d9b32-24d8-4673-946c-db3c7510f6dd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Deleting offline snapshot b94d9b32-24d8-4673-946c-db3c7510f6dd of volume 13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] snapshot_file for this snap is: volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2975d6-c9fb-4f17-966d-afb9469ba5b4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:52 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd Jun 29 03:09:52 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:52 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb 1073741824" returned: 0 in 1.276s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:52 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb Jun 29 03:09:52 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:53 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd" returned: 0 in 1.202s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13750404-429d-4b31-9901-5f0d6eb98ee9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae177209-22d9-44de-a7ed-74bff268dba3]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:53 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:53 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:53 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb" returned: 0 in 1.056s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03840fb-5580-4ab0-b0e1-0b0e5b6d6b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9016d295-1fa9-46fa-b7b9-36a5bcacee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Flow 'volume_create_manager' (36b12d3a-f1b2-4f98-9607-433fffc95418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c7d3f9-1641-4dec-a8a8-3498d36966cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Volume volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb (89225fd6-36db-4c36-bae8-b9dc0a0848eb): created successfully Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9016d295-1fa9-46fa-b7b9-36a5bcacee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Flow 'volume_create_manager' (726d97c1-04a8-4cf3-941c-4a39b3875aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c7d3f9-1641-4dec-a8a8-3498d36966cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1710724299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5646fcf-f0e2-4e40-8278-2ffaa26c1c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d917e4d4904b958f8522f0a55bc3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:54Z,use_quota=True,user_id='d624afd24ff44ee2b1002a6a1de42ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfef0f47-093c-44e1-a560-bd9494a31c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfef0f47-093c-44e1-a560-bd9494a31c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9e08ea-b250-4c9e-8ea1-363a166a2813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:53 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:09:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-514abcf2-8a9e-438d-b1bc-4a87ecac4d54 tempest-AttachVolumeTestJSON-1890221435 None] Created volume successfully. Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b9e08ea-b250-4c9e-8ea1-363a166a2813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c5646fcf-f0e2-4e40-8278-2ffaa26c1c02', 'volume_name': 'volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ab4024-8190-40e8-9ff2-474cf5ae8432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ab4024-8190-40e8-9ff2-474cf5ae8432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32f1b48-d5f9-4d83-b999-481e2387bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:09:54 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Volume c5646fcf-f0e2-4e40-8278-2ffaa26c1c02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Trying to clone c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:09:54 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 1.121s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:54 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd Jun 29 03:09:54 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:09:54 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7da9259-ce3f-47aa-95bf-6aca8f99082b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:54 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD Jun 29 03:09:54 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:55 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd" returned: 0 in 1.033s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:55 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd Jun 29 03:09:55 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:55 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:55 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 is fetched for user d624afd24ff44ee2b1002a6a1de42ea3. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:09:55 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caa3159-fd8a-4dbe-944a-9c04a3401443]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:55 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD Jun 29 03:09:55 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:56 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9.b94d9b32-24d8-4673-946c-db3c7510f6dd" returned: 0 in 0.982s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-b94d9b32-24d8-4673-946c-db3c7510f6dd" released by "_delete_snapshot" :: held 4.495s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-13750404-429d-4b31-9901-5f0d6eb98ee9" released by "delete_snapshot" :: held 4.524s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:56 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1710724299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5646fcf-f0e2-4e40-8278-2ffaa26c1c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d917e4d4904b958f8522f0a55bc3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:09:54Z,use_quota=True,user_id='d624afd24ff44ee2b1002a6a1de42ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Creating volume c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:09:56 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Created reservations ['223bd066-84fe-445e-a312-521569f96d31', '602216e4-b951-46be-aa5a-449880ee5438', 'a7ab8106-e91a-4f86-b38d-b90367027bbb', '639fde58-774f-4bd4-b29d-3a445a5462b8'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:56 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 1073741824 Jun 29 03:09:56 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:56 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Delete snapshot completed successfully. Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-b94d9b32-24d8-4673-946c-db3c7510f6dd-delete_snapshot" released by "delete_snapshot" :: held 4.780s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Snapshots deleted, issuing volume delete {{(pid=93518) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-13750404-429d-4b31-9901-5f0d6eb98ee9" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-13750404-429d-4b31-9901-5f0d6eb98ee9" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc157f3-0be5-426f-81f4-b76e83a7ee39]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:56 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:56 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:57 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 0.917s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:57 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 1073741824" returned: 0 in 1.164s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:57 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9 Jun 29 03:09:57 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:57 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:09:57 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:58 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-13750404-429d-4b31-9901-5f0d6eb98ee9" returned: 0 in 0.821s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-13750404-429d-4b31-9901-5f0d6eb98ee9" released by "delete_volume" :: held 1.827s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Created reservations ['a7cfd5d1-a60f-4f9e-ab4d-3ada05de4423', '6809c358-a4ad-4410-9963-e291be071fb9', '9c07116b-b82f-44b4-94a1-8082fd901faf', '204e016e-8b7e-460d-8815-fcd03faaf0f5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:09:58 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 0 in 0.850s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.542s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceca04f-d12d-4c62-8a52-9527d375ff4d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Attempting download of ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume c5646fcf-f0e2-4e40-8278-2ffaa26c1c02. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:09:58 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:09:58 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d91a03-d64f-484d-b635-b22f287bc31f]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:09:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:58 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb Jun 29 03:09:58 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:59 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53 Jun 29 03:09:59 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:59 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb" returned: 0 in 1.030s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.063s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:09:59 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53" returned: 0 in 0.954s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:09:59 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89545ff9-b44a-420f-8a02-1acfc6d85b6e', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.088s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:09:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Deleted volume successfully. Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b19484fc-c0ab-43ed-850e-0e14c49ef709 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-13750404-429d-4b31-9901-5f0d6eb98ee9-delete_volume" released by "delete_volume" :: held 8.012s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:09:59 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53 Jun 29 03:09:59 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:09:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-229eb67c-fd91-4e65-a567-39b557aa121b req-119155b5-fd25-452e-9b8f-29239d63249d tempest-AttachVolumeTestJSON-1890221435 None] attachment_update completed successfully. Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "cinder-quobyte-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[136e27ef-3df6-48af-8f7b-a332e3886e21]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:00 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 Jun 29 03:10:00 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:00 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53" returned: 1 in 0.930s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_ouwzhy53' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[177b5e25-cbd5-44cc-b088-fd07854a09ce]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:00 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD Jun 29 03:10:00 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:01 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" returned: 0 in 0.960s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:01 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3 Jun 29 03:10:01 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:01 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD" returned: 0 in 1.000s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:01 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 was qcow2, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:10:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:01 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:01 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:01 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" returned: 0 in 0.925s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-quobyte-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3" released by "delete_volume" :: held 1.944s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Created reservations ['e0e65b83-8323-4e15-89a4-24c4f1217daa', '31197fdd-7a0d-4cbb-abab-e1eabc117193', '60f23387-d925-4119-9a21-fce5410718e9', 'a2c3b32c-53ef-4763-a958-07892aba6f22'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:02 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:10:02 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:03 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.806s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:03 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:10:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Deleted volume successfully. Jun 29 03:10:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f24678cf-c0cf-45c1-a189-f3121e3e7438 tempest-VolumesDeleteCascade-306481324 None] Lock "cinder-fb2fdb24-8b0d-4700-b873-6e0d0aa91ac3-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:04 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 0 in 2.712s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:04 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r9gdrznfdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:10:04 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Converted 112.00 MB image at 41.27 MB/s Jun 29 03:10:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:04 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 1G Jun 29 03:10:04 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:05 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 1G" returned: 0 in 1.210s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:05 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f380f4-0e6c-4f6d-af22-7700a8e0650d]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:05 devstack sudo[103384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:05 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:06 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 0 in 1.180s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:07 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:07 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Flow 'volume_create_manager' (8721c5d6-6fc3-4172-b91b-b1b7c9d7f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c414133-be29-4244-9d9e-0b2d3087fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c414133-be29-4244-9d9e-0b2d3087fc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1078783019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4fc599-9ba3-45ce-8368-2275ae73b9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e953952f0e194ac08557fdb384358fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:08Z,use_quota=True,user_id='ee57f19a3b5845f5ac45b110aa56a3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4476718-db13-4643-b8d3-44131ca9eac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4476718-db13-4643-b8d3-44131ca9eac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b2e8a9-66dd-4d19-bc10-90a7ac4a2547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b2e8a9-66dd-4d19-bc10-90a7ac4a2547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4fc599-9ba3-45ce-8368-2275ae73b9ce', 'volume_name': 'volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce', 'volume_size': 2}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c90419-0cc9-44a1-bcf4-559b2a9a325c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2c90419-0cc9-44a1-bcf4-559b2a9a325c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd3d418-230f-4959-bc7d-225a07ddbe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:08 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Volume db4fc599-9ba3-45ce-8368-2275ae73b9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce', 'volume_size': 2} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1078783019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4fc599-9ba3-45ce-8368-2275ae73b9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e953952f0e194ac08557fdb384358fa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:08Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:08Z,use_quota=True,user_id='ee57f19a3b5845f5ac45b110aa56a3d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Creating volume db4fc599-9ba3-45ce-8368-2275ae73b9ce {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:08 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce 2147483648 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:08 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce 2147483648 Jun 29 03:10:08 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:08 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 1 in 1.463s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Downloaded image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 for user d624afd24ff44ee2b1002a6a1de42ea3 is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Marking volume c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Copying metadata from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 to c5646fcf-f0e2-4e40-8278-2ffaa26c1c02. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Creating volume glance metadata for volume c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 backed by image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32f1b48-d5f9-4d83-b999-481e2387bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1454b0b-ba8a-4d27-ad88-0172d257a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:08 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Volume volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 (c5646fcf-f0e2-4e40-8278-2ffaa26c1c02): created successfully Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1454b0b-ba8a-4d27-ad88-0172d257a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Flow 'volume_create_manager' (36b12d3a-f1b2-4f98-9607-433fffc95418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dd697c3f-a176-4594-ba48-5309c6c15f1a tempest-VolumesExtendTest-1445410900 None] Created volume successfully. Jun 29 03:10:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:09 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce 2147483648" returned: 0 in 1.295s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:09 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce Jun 29 03:10:09 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:10 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce" returned: 0 in 0.931s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.447s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd3d418-230f-4959-bc7d-225a07ddbe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce', 'volume_size': 2}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6495456-74b9-4fb4-b51c-e6668a732c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d8f8e-a6d2-459d-be79-42eeba35d81c]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:10 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Volume volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce (db4fc599-9ba3-45ce-8368-2275ae73b9ce): created successfully Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6495456-74b9-4fb4-b51c-e6668a732c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Flow 'volume_create_manager' (8721c5d6-6fc3-4172-b91b-b1b7c9d7f676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ccc5ed88-26af-4853-b58d-8c4b5f377993 tempest-VolumesCloneNegativeTest-1276954610 None] Created volume successfully. Jun 29 03:10:10 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:10 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:11 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 0 in 0.818s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Acquiring lock "cinder-db4fc599-9ba3-45ce-8368-2275ae73b9ce-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Lock "cinder-db4fc599-9ba3-45ce-8368-2275ae73b9ce-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Acquiring lock "cinder-quobyte-db4fc599-9ba3-45ce-8368-2275ae73b9ce" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:11 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:11 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Lock "cinder-quobyte-db4fc599-9ba3-45ce-8368-2275ae73b9ce" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e80ef7-e304-4362-96d5-d953c9937389]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:11 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce Jun 29 03:10:11 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:12 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 1 in 0.966s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 2G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 2G" returned: 0 in 0.081s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.909s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3ea37751-933e-4ab5-ae46-72546edfdb44 tempest-VolumesExtendTest-1445410900 None] Extend volume completed successfully. Jun 29 03:10:12 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce" returned: 0 in 0.893s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:12 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce Jun 29 03:10:12 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:13 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-db4fc599-9ba3-45ce-8368-2275ae73b9ce" returned: 0 in 0.688s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Lock "cinder-quobyte-db4fc599-9ba3-45ce-8368-2275ae73b9ce" released by "delete_volume" :: held 1.656s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Created reservations ['5c41bbd3-71de-4968-acad-1c82789173c2', 'b8e0a0b3-4701-41b3-bc30-90ddcfd7159c', '71ea5fff-67b9-40cb-8be5-8330229386e6', '2b136d6f-64a1-4298-b2cf-587b7f627554'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:13 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:10:13 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Lock "cinder-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-quobyte-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc77f5b-2451-414f-a226-42bd4c9bc956]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:14 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:14 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:14 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.848s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:10:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Deleted volume successfully. Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8fd5ca2e-72eb-44ba-b404-8fc0f4ab0cdf tempest-VolumesCloneNegativeTest-1276954610 None] Lock "cinder-db4fc599-9ba3-45ce-8368-2275ae73b9ce-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Flow 'volume_create_manager' (056d5c5c-7a4e-4619-b2e5-7249e002119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d95d987-c7b4-4cf9-a415-777bdfdbd883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d95d987-c7b4-4cf9-a415-777bdfdbd883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1233708325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f0a9df-0a76-471a-b48a-c7f7ee960a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b41fd80ae244808d8ef7aa9a043929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:15Z,use_quota=True,user_id='e511d1666ad64075a299b4a9ffd6ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(983dd135-04f4-4e5a-b6e1-d0334cf7b8bb),volume_type_id=983dd135-04f4-4e5a-b6e1-d0334cf7b8bb)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e525f94c-8114-40d8-9a32-21ce23d24731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e525f94c-8114-40d8-9a32-21ce23d24731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7553c517-7999-41e3-9085-8fe895a36ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7553c517-7999-41e3-9085-8fe895a36ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f0a9df-0a76-471a-b48a-c7f7ee960a31', 'volume_name': 'volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1575e49-74c1-4d44-b45a-61cacbe6066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1575e49-74c1-4d44-b45a-61cacbe6066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e25c08-16e3-449d-8bcf-cf13ef8b7d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:14 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume 92f0a9df-0a76-471a-b48a-c7f7ee960a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31', 'volume_size': 1} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1233708325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f0a9df-0a76-471a-b48a-c7f7ee960a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b41fd80ae244808d8ef7aa9a043929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:15Z,use_quota=True,user_id='e511d1666ad64075a299b4a9ffd6ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(983dd135-04f4-4e5a-b6e1-d0334cf7b8bb),volume_type_id=983dd135-04f4-4e5a-b6e1-d0334cf7b8bb)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Creating volume 92f0a9df-0a76-471a-b48a-c7f7ee960a31 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:14 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:14 devstack sudo[103476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 1073741824 Jun 29 03:10:14 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:15 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 0 in 1.173s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:15 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:15 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Flow 'volume_create_manager' (b8b3313a-eb51-49db-a6bc-7404dbeaada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b995c2-e93f-4947-b407-4c879e181530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b995c2-e93f-4947-b407-4c879e181530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-821153026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41ce92e-9ac2-4680-a735-d3d059ced4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b41fd80ae244808d8ef7aa9a043929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:16Z,use_quota=True,user_id='e511d1666ad64075a299b4a9ffd6ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e491e4c6-d759-4a0f-b617-02d2774593e5),volume_type_id=e491e4c6-d759-4a0f-b617-02d2774593e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f96f4c-c97d-48f3-878a-fea74be5c8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f96f4c-c97d-48f3-878a-fea74be5c8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414329a9-469b-4fb5-8b24-78449a898582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414329a9-469b-4fb5-8b24-78449a898582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41ce92e-9ac2-4680-a735-d3d059ced4f3', 'volume_name': 'volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549cc243-fc16-4b9a-8c11-db6d6112b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549cc243-fc16-4b9a-8c11-db6d6112b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca9923c-d2d3-471e-a613-f1e0c0c1eced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:15 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume a41ce92e-9ac2-4680-a735-d3d059ced4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3', 'volume_size': 1} Jun 29 03:10:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:16 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 1073741824" returned: 0 in 1.517s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:16 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 1 in 1.386s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:16 devstack sudo[103578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 Jun 29 03:10:16 devstack sudo[103578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:16 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02 Jun 29 03:10:16 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Flow 'volume_create_manager' (898be83a-d711-41d1-9f57-a4c39b5adcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de366a79-4ac6-4d5f-9936-61c336ecac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de366a79-4ac6-4d5f-9936-61c336ecac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1779484124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4021783b-ad33-4589-be05-f942900a6fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b41fd80ae244808d8ef7aa9a043929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:16Z,use_quota=True,user_id='e511d1666ad64075a299b4a9ffd6ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4a32c0f-ec73-4c8f-9381-2e860851fc87),volume_type_id=f4a32c0f-ec73-4c8f-9381-2e860851fc87)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a114550-b7ae-49b6-ac97-02ed913deaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a114550-b7ae-49b6-ac97-02ed913deaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a86c76-4455-4bb0-8256-d5979ccc8232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:16 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88a86c76-4455-4bb0-8256-d5979ccc8232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4021783b-ad33-4589-be05-f942900a6fdc', 'volume_name': 'volume-4021783b-ad33-4589-be05-f942900a6fdc', 'volume_size': 1, 'image_id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ebda39a-5230-499e-bf0c-3c6450777251', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--633225564', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b41fd80ae244808d8ef7aa9a043929', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'created_at': datetime.datetime(2026, 6, 29, 1, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ebda39a-5230-499e-bf0c-3c6450777251/file', 'properties': {}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e35c36-9615-4484-bcbd-3652f830bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e35c36-9615-4484-bcbd-3652f830bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d21709-5635-4907-8ba6-9dca82409629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume 4021783b-ad33-4589-be05-f942900a6fdc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4021783b-ad33-4589-be05-f942900a6fdc', 'volume_size': 1, 'image_id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ebda39a-5230-499e-bf0c-3c6450777251', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--633225564', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b41fd80ae244808d8ef7aa9a043929', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'created_at': datetime.datetime(2026, 6, 29, 1, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ebda39a-5230-499e-bf0c-3c6450777251/file', 'properties': {}}, 'image_service': } Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Trying to clone 4021783b-ad33-4589-be05-f942900a6fdc from image 8ebda39a-5230-499e-bf0c-3c6450777251 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ebda39a-5230-499e-bf0c-3c6450777251', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:10:17 devstack sudo[103578]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31" returned: 0 in 1.000s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] <== create_volume: return (2583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.594s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:17 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.702s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-821153026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41ce92e-9ac2-4680-a735-d3d059ced4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b41fd80ae244808d8ef7aa9a043929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:16Z,use_quota=True,user_id='e511d1666ad64075a299b4a9ffd6ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e491e4c6-d759-4a0f-b617-02d2774593e5),volume_type_id=e491e4c6-d759-4a0f-b617-02d2774593e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Creating volume a41ce92e-9ac2-4680-a735-d3d059ced4f3 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:17 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" returned: 0 in 1.002s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:17 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 1073741824 Jun 29 03:10:17 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e25c08-16e3-449d-8bcf-cf13ef8b7d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d465fb-eba9-4a06-aca8-9c1be9747c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02" released by "delete_volume" :: held 3.694s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 (92f0a9df-0a76-471a-b48a-c7f7ee960a31): created successfully Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2d465fb-eba9-4a06-aca8-9c1be9747c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Flow 'volume_create_manager' (056d5c5c-7a4e-4619-b2e5-7249e002119d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3aeffb93-77af-472d-8fde-b119bd4aa338 tempest-TestInstancesWithCinderVolumes-1810863045 None] Created volume successfully. Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:17 devstack sudo[103592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:10:17 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Created reservations ['8fe78050-e8e3-42f5-b25d-d651193ac533', '0fd790b0-ff63-4b7d-9c7b-12049a5a714e', 'e712750b-8f25-491c-a8de-209833e036e5', 'fbddaebf-e5c7-4849-bdaa-aed92065ea6e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=103,cinder:UPDATE=102,cinder:INSERT=26,cinder:DELETE=8 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:17 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:10:17 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:18 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.273s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:10:18 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.115s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:10:18 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Deleted volume successfully. Jun 29 03:10:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e88ee0b3-6a6d-4367-aede-e4a1dd006afc tempest-VolumesExtendTest-1445410900 None] Lock "cinder-c5646fcf-f0e2-4e40-8278-2ffaa26c1c02-delete_volume" released by "delete_volume" :: held 5.225s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:18 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 1073741824" returned: 0 in 1.534s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:19 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 Jun 29 03:10:19 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Flow 'volume_create_manager' (781a8d23-45d6-424d-8282-a62bb3f52f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbd488b-63bf-4a72-b934-bc766f920c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbd488b-63bf-4a72-b934-bc766f920c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-360596148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249623d1-050f-4321-982c-350a03af9a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d917e4d4904b958f8522f0a55bc3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:19Z,use_quota=True,user_id='d624afd24ff44ee2b1002a6a1de42ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e1e818-6ae5-4aa7-bcfb-5357b0dc0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e1e818-6ae5-4aa7-bcfb-5357b0dc0b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6325a533-6d25-4684-94b8-3b295b831740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6325a533-6d25-4684-94b8-3b295b831740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '249623d1-050f-4321-982c-350a03af9a04', 'volume_name': 'volume-249623d1-050f-4321-982c-350a03af9a04', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e27556e-7c45-4a3c-8c5b-2a1c1efa9785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e27556e-7c45-4a3c-8c5b-2a1c1efa9785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f035588b-f509-49d7-9fea-53d41eea1d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Volume 249623d1-050f-4321-982c-350a03af9a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-249623d1-050f-4321-982c-350a03af9a04', 'volume_size': 1} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:19 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3" returned: 0 in 0.817s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] <== create_volume: return (2399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.402s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.586s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-360596148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=249623d1-050f-4321-982c-350a03af9a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d917e4d4904b958f8522f0a55bc3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:19Z,use_quota=True,user_id='d624afd24ff44ee2b1002a6a1de42ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Creating volume 249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:19 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca9923c-d2d3-471e-a613-f1e0c0c1eced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1c6ecf-657e-4fd4-8e71-16a9f1e71b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:19 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 1073741824 Jun 29 03:10:19 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 (a41ce92e-9ac2-4680-a735-d3d059ced4f3): created successfully Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1c6ecf-657e-4fd4-8e71-16a9f1e71b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Flow 'volume_create_manager' (b8b3313a-eb51-49db-a6bc-7404dbeaada7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4ebbcc6c-9141-4487-ac97-79d399359ae6 tempest-TestInstancesWithCinderVolumes-1810863045 None] Created volume successfully. Jun 29 03:10:21 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 1073741824" returned: 0 in 1.384s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:21 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 Jun 29 03:10:21 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:22 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04" returned: 0 in 1.024s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.486s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f035588b-f509-49d7-9fea-53d41eea1d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-249623d1-050f-4321-982c-350a03af9a04', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fc1992-6ca7-4b1d-bc21-dea91530915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Volume volume-249623d1-050f-4321-982c-350a03af9a04 (249623d1-050f-4321-982c-350a03af9a04): created successfully Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fc1992-6ca7-4b1d-bc21-dea91530915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Flow 'volume_create_manager' (781a8d23-45d6-424d-8282-a62bb3f52f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d1934ddf-e713-4cd3-9621-a11eeee97532 tempest-VolumesExtendTest-1445410900 None] Created volume successfully. Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD, size 20.69 MB, duration 5.91 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:10:23 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Image download 20.69 MB at 3.50 MB/s Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7113807-9a40-439f-9e88-a4d2a8954335]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:23 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD Jun 29 03:10:23 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Flow 'volume_create_manager' (b2d8caf6-13dd-4570-9292-d7b409d9f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59a78a4-c882-4956-951a-4576cd1fd34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59a78a4-c882-4956-951a-4576cd1fd34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3ac179-53dd-43c9-b7f6-c5b200ca2384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7045075b07064aab820b3592c8b90912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:24Z,use_quota=True,user_id='2f13c230ca9d468e8dbb7bf2d356cfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfd8c4eb-d307-4f61-8d82-bda473dff68e),volume_type_id=cfd8c4eb-d307-4f61-8d82-bda473dff68e)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58cddaa-40b2-430a-8e1d-549a0a480a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58cddaa-40b2-430a-8e1d-549a0a480a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caf1bc7-b228-4233-8aa6-cd188b4ae1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Creating offline snapshot 5676b3ea-c1cc-424c-8cea-c816079ec4ba of volume 249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1eaa05b-b2a6-434a-afd2-8b3a69a8c853]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:24 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 Jun 29 03:10:24 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:24 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD" returned: 0 in 1.135s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Temporary image 8ebda39a-5230-499e-bf0c-3c6450777251 is fetched for user e511d1666ad64075a299b4a9ffd6ed0a. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2caf1bc7-b228-4233-8aa6-cd188b4ae1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e3ac179-53dd-43c9-b7f6-c5b200ca2384', 'volume_name': 'volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384', 'volume_size': 1, 'image_id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae17e3e0-0729-4010-b01a-be61f6292c41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ca9a7c099b1914491d15821dc9bcad2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7045075b07064aab820b3592c8b90912', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35ab983dc32a07b6dd2721a937c8f93dd0cb3f1ac81f6df3531c769491f6d3c0dbe50faf054ba273dc47bb1074a3368d3ae51e9605f31f14136de4145dfbfe98', 'id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'created_at': datetime.datetime(2026, 6, 29, 1, 10, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 10, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae17e3e0-0729-4010-b01a-be61f6292c41/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e54d4c4-3f89-4449-8594-e48baaf4494e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e54d4c4-3f89-4449-8594-e48baaf4494e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0f1c4b-8a5d-4aa1-b237-f25e12617037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:24 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Volume 9e3ac179-53dd-43c9-b7f6-c5b200ca2384: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384', 'volume_size': 1, 'image_id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae17e3e0-0729-4010-b01a-be61f6292c41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ca9a7c099b1914491d15821dc9bcad2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7045075b07064aab820b3592c8b90912', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35ab983dc32a07b6dd2721a937c8f93dd0cb3f1ac81f6df3531c769491f6d3c0dbe50faf054ba273dc47bb1074a3368d3ae51e9605f31f14136de4145dfbfe98', 'id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'created_at': datetime.datetime(2026, 6, 29, 1, 10, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 10, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae17e3e0-0729-4010-b01a-be61f6292c41/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Trying to clone 9e3ac179-53dd-43c9-b7f6-c5b200ca2384 from image ae17e3e0-0729-4010-b01a-be61f6292c41 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ae17e3e0-0729-4010-b01a-be61f6292c41', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fadd314-abfb-4dcd-a2d1-5801ec2322ee]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:10:24 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca0a7cd-715e-41d7-87de-efee65dbaef9]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:24 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD Jun 29 03:10:24 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:24 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD Jun 29 03:10:24 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:25 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04" returned: 0 in 1.081s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:25 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba 1G Jun 29 03:10:25 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:25 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD" returned: 0 in 1.081s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:25 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD" returned: 0 in 1.008s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:25 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD Jun 29 03:10:25 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:26 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba 1G" returned: 0 in 0.936s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249623d1-050f-4321-982c-350a03af9a04 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:26 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249623d1-050f-4321-982c-350a03af9a04 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba Jun 29 03:10:26 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:26 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Temporary image ae17e3e0-0729-4010-b01a-be61f6292c41 is fetched for user 2f13c230ca9d468e8dbb7bf2d356cfa0. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5151da4-60cf-440a-af3c-459d9afe5476]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:26 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD Jun 29 03:10:26 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:26 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-249623d1-050f-4321-982c-350a03af9a04 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba" returned: 0 in 0.697s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:26 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba is being set with open permissions: ugo+rw Jun 29 03:10:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:26 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba Jun 29 03:10:26 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:27 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:27 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba" returned: 0 in 0.679s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:27 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD Jun 29 03:10:27 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:27 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info Jun 29 03:10:27 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:28 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:28 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD" returned: 1 in 0.788s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:28 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info is being set with open permissions: ugo+rw Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:28 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info Jun 29 03:10:28 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:28 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.info" returned: 0 in 0.625s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.842s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.263s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1779484124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4021783b-ad33-4589-be05-f942900a6fdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4b41fd80ae244808d8ef7aa9a043929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:16Z,use_quota=True,user_id='e511d1666ad64075a299b4a9ffd6ed0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4a32c0f-ec73-4c8f-9381-2e860851fc87),volume_type_id=f4a32c0f-ec73-4c8f-9381-2e860851fc87)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Creating volume 4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:28 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:28 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc 1073741824 Jun 29 03:10:28 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-539aaaea-c414-48cb-8192-0d8c075b3712 tempest-VolumesExtendTest-1445410900 None] Create snapshot completed successfully Jun 29 03:10:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:29 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc 1073741824" returned: 0 in 0.813s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:29 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:10:29 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:30 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 0 in 0.612s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.135s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3ac179-53dd-43c9-b7f6-c5b200ca2384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7045075b07064aab820b3592c8b90912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:24Z,use_quota=True,user_id='2f13c230ca9d468e8dbb7bf2d356cfa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cfd8c4eb-d307-4f61-8d82-bda473dff68e),volume_type_id=cfd8c4eb-d307-4f61-8d82-bda473dff68e)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Creating volume 9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:30 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:30 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 1073741824 Jun 29 03:10:30 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Attempting download of 8ebda39a-5230-499e-bf0c-3c6450777251 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ebda39a-5230-499e-bf0c-3c6450777251', 'metadata': {}}])) to volume 4021783b-ad33-4589-be05-f942900a6fdc. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffc4669-65e4-461e-9b23-00e82238c1ac]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:30 devstack sudo[104104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9 Jun 29 03:10:30 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:31 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:31 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 1073741824" returned: 0 in 0.904s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9" returned: 0 in 0.812s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:31 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:31 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:31 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9 Jun 29 03:10:31 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:31 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 0 in 0.672s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.617s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[561fbff5-3452-4e4d-91ae-cc9f1757366a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:31 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9" returned: 1 in 0.783s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ebda39a-5230-499e-bf0c-3c6450777251_shsafps9' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e796450a-9e9f-4907-ad92-2c5567388992]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:31 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Attempting download of ae17e3e0-0729-4010-b01a-be61f6292c41 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae17e3e0-0729-4010-b01a-be61f6292c41', 'metadata': {}}])) to volume 9e3ac179-53dd-43c9-b7f6-c5b200ca2384. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba2f75-656f-489c-b0e6-c830f4e9bfc0]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:32 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 Jun 29 03:10:32 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:32 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD Jun 29 03:10:32 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:32 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8 Jun 29 03:10:32 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:32 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] 8ebda39a-5230-499e-bf0c-3c6450777251 was qcow2, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:32 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8" returned: 0 in 0.780s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:32 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:10:32 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:32 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04" returned: 0 in 0.998s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba 2G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:32 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8 Jun 29 03:10:32 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba 2G" returned: 0 in 0.174s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.213s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3a5a1369-fff4-4321-98ac-562da8991cc9 tempest-VolumesExtendTest-1445410900 None] Extend volume completed successfully. Jun 29 03:10:33 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8" returned: 1 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ae17e3e0-0729-4010-b01a-be61f6292c41_gknpfsh8' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baf0a6f-2daf-460d-bc03-27dfcd70c4b1]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:33 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD Jun 29 03:10:33 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-5676b3ea-c1cc-424c-8cea-c816079ec4ba-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Lock "cinder-5676b3ea-c1cc-424c-8cea-c816079ec4ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-quobyte-249623d1-050f-4321-982c-350a03af9a04" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-249623d1-050f-4321-982c-350a03af9a04" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-quobyte-5676b3ea-c1cc-424c-8cea-c816079ec4ba" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-5676b3ea-c1cc-424c-8cea-c816079ec4ba" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Deleting offline snapshot 5676b3ea-c1cc-424c-8cea-c816079ec4ba of volume 249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] snapshot_file for this snap is: volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea59c0-16ec-45bd-b9e8-2091a0485918]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:34 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba Jun 29 03:10:34 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:34 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD" returned: 0 in 1.034s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:34 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD Jun 29 03:10:34 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:34 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba" returned: 0 in 0.955s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-249623d1-050f-4321-982c-350a03af9a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e4d0f2-79db-4895-ae47-49101338cf38]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:35 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 0 in 2.273s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ebda39a-5230-499e-bf0c-3c6450777251_pswsy10sdevstack@QuobyteHD, size 112.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:10:35 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Converted 112.00 MB image at 49.20 MB/s Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:35 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc 1G Jun 29 03:10:35 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:35 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 Jun 29 03:10:35 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:35 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD" returned: 1 in 0.894s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] ae17e3e0-0729-4010-b01a-be61f6292c41 was raw, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:35 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:35 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:35 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc 1G" returned: 0 in 0.790s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:35 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04" returned: 0 in 0.883s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ecf28d-0884-4023-9d32-e63f4b7c0269]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:35 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba Jun 29 03:10:35 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:36 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:10:36 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:36 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ae17e3e0-0729-4010-b01a-be61f6292c41_6utk44psdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:10:36 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:36 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 1G Jun 29 03:10:36 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:36 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 0 in 0.833s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:36 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba" returned: 0 in 0.938s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:36 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba Jun 29 03:10:36 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:36 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:10:36 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:37 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 1G" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef37b8-9cc7-4c59-b0d4-98846b672168]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:37 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:37 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:37 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04.5676b3ea-c1cc-424c-8cea-c816079ec4ba" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-5676b3ea-c1cc-424c-8cea-c816079ec4ba" released by "_delete_snapshot" :: held 3.648s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-249623d1-050f-4321-982c-350a03af9a04" released by "delete_snapshot" :: held 3.680s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:37 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 1 in 0.831s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Downloaded image 8ebda39a-5230-499e-bf0c-3c6450777251 ((None, [{'url': 'file:///opt/stack/data/glance/images/8ebda39a-5230-499e-bf0c-3c6450777251', 'metadata': {}}])) to volume 4021783b-ad33-4589-be05-f942900a6fdc successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Temporary image 8ebda39a-5230-499e-bf0c-3c6450777251 for user e511d1666ad64075a299b4a9ffd6ed0a is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Marking volume 4021783b-ad33-4589-be05-f942900a6fdc as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Copying metadata from image 8ebda39a-5230-499e-bf0c-3c6450777251 to 4021783b-ad33-4589-be05-f942900a6fdc. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Creating volume glance metadata for volume 4021783b-ad33-4589-be05-f942900a6fdc backed by image 8ebda39a-5230-499e-bf0c-3c6450777251 with: {'image_id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'image_name': 'tempest-scenario-img--633225564', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Created reservations ['e4c5fd0a-f6eb-4b07-90ca-3872b709883e', 'adb36706-f062-406b-af6a-b778d89fcfb6', 'b29ee920-08ee-43e0-8a9f-33a1929573db', '5063b17d-1708-4fb2-919e-1115e64d6fc8'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d21709-5635-4907-8ba6-9dca82409629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4021783b-ad33-4589-be05-f942900a6fdc', 'volume_size': 1, 'image_id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ebda39a-5230-499e-bf0c-3c6450777251', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--633225564', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e4b41fd80ae244808d8ef7aa9a043929', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8ebda39a-5230-499e-bf0c-3c6450777251', 'created_at': datetime.datetime(2026, 6, 29, 1, 10, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 10, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ebda39a-5230-499e-bf0c-3c6450777251/file', 'properties': {}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066522bd-f772-471c-a8b4-6e54c003ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:37 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Volume volume-4021783b-ad33-4589-be05-f942900a6fdc (4021783b-ad33-4589-be05-f942900a6fdc): created successfully Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (066522bd-f772-471c-a8b4-6e54c003ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Flow 'volume_create_manager' (898be83a-d711-41d1-9f57-a4c39b5adcb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:37 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-91ac62b2-fad3-4721-ac84-cdaa902eb83f tempest-TestInstancesWithCinderVolumes-1810863045 None] Created volume successfully. Jun 29 03:10:37 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Delete snapshot completed successfully. Jun 29 03:10:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c8ac0a9-af2b-4ba2-a297-cf1c85260bfd tempest-VolumesExtendTest-1445410900 None] Lock "cinder-5676b3ea-c1cc-424c-8cea-c816079ec4ba-delete_snapshot" released by "delete_snapshot" :: held 3.918s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:38 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 0 in 0.830s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:38 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:38 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-249623d1-050f-4321-982c-350a03af9a04-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Lock "cinder-249623d1-050f-4321-982c-350a03af9a04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Acquiring lock "cinder-quobyte-249623d1-050f-4321-982c-350a03af9a04" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-249623d1-050f-4321-982c-350a03af9a04" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e7dae-cb60-4a98-b01e-3c2bdfd30637]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:38 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 Jun 29 03:10:38 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:38 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 1 in 0.825s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Downloaded image ae17e3e0-0729-4010-b01a-be61f6292c41 ((None, [{'url': 'file:///opt/stack/data/glance/images/ae17e3e0-0729-4010-b01a-be61f6292c41', 'metadata': {}}])) to volume 9e3ac179-53dd-43c9-b7f6-c5b200ca2384 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Temporary image ae17e3e0-0729-4010-b01a-be61f6292c41 for user 2f13c230ca9d468e8dbb7bf2d356cfa0 is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Marking volume 9e3ac179-53dd-43c9-b7f6-c5b200ca2384 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Copying metadata from image ae17e3e0-0729-4010-b01a-be61f6292c41 to 9e3ac179-53dd-43c9-b7f6-c5b200ca2384. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Creating volume glance metadata for volume 9e3ac179-53dd-43c9-b7f6-c5b200ca2384 backed by image ae17e3e0-0729-4010-b01a-be61f6292c41 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8ca9a7c099b1914491d15821dc9bcad2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0f1c4b-8a5d-4aa1-b237-f25e12617037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384', 'volume_size': 1, 'image_id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ae17e3e0-0729-4010-b01a-be61f6292c41', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ca9a7c099b1914491d15821dc9bcad2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7045075b07064aab820b3592c8b90912', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35ab983dc32a07b6dd2721a937c8f93dd0cb3f1ac81f6df3531c769491f6d3c0dbe50faf054ba273dc47bb1074a3368d3ae51e9605f31f14136de4145dfbfe98', 'id': 'ae17e3e0-0729-4010-b01a-be61f6292c41', 'created_at': datetime.datetime(2026, 6, 29, 1, 10, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 10, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ae17e3e0-0729-4010-b01a-be61f6292c41/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e15cdf-5af6-4e7f-b59e-ad365e9dad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:38 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Volume volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 (9e3ac179-53dd-43c9-b7f6-c5b200ca2384): created successfully Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e15cdf-5af6-4e7f-b59e-ad365e9dad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Flow 'volume_create_manager' (b2d8caf6-13dd-4570-9292-d7b409d9f52d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6bf39d3b-bace-4213-a97c-fe52a530d21c tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Created volume successfully. Jun 29 03:10:39 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04" returned: 0 in 0.793s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:39 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04 Jun 29 03:10:39 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:39 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-249623d1-050f-4321-982c-350a03af9a04" returned: 0 in 0.699s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Lock "cinder-quobyte-249623d1-050f-4321-982c-350a03af9a04" released by "delete_volume" :: held 1.558s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Created reservations ['0fa572ff-dbab-42af-a504-937ac482d26c', '38980934-9384-4f86-a7d4-797eb37d16c0', '9dccdd37-4269-4c33-a193-09be32c86553', '05c8cd5d-00d7-48fc-8ed1-17e68c8ddab9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Acquiring lock "cinder-9e3ac179-53dd-43c9-b7f6-c5b200ca2384-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "cinder-9e3ac179-53dd-43c9-b7f6-c5b200ca2384-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:39 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:10:39 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Acquiring lock "cinder-quobyte-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "cinder-quobyte-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3e1749-5a5b-4b64-85b7-4488b2f8ae7d]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:40 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:40 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:40 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.727s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:10:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Deleted volume successfully. Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-103cf09d-9217-4ad2-bccc-6a94b90d027e tempest-VolumesExtendTest-1445410900 None] Lock "cinder-249623d1-050f-4321-982c-350a03af9a04-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:40 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 0 in 0.908s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:41 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:41 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:41 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 1 in 0.974s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:42 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384 Jun 29 03:10:42 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:42 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" returned: 0 in 0.848s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "cinder-quobyte-9e3ac179-53dd-43c9-b7f6-c5b200ca2384" released by "delete_volume" :: held 2.805s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=79,cinder:INSERT=47,cinder:UPDATE=107,cinder:DELETE=6 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:10:42 devstack cinder-volume[93518]: WARNING cinder.quota [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:10:42 devstack cinder-volume[93518]: WARNING cinder.quota [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Created reservations ['3366eeab-d48d-4ef8-a58b-cc76deff395e', '9d3ef336-08a4-47d3-9047-65da8214603f', '2da3ecff-f44c-4e3e-b8c1-36f1b96a5ec7', 'c9977bb7-460b-408e-86f5-6a386e5e9d8b'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:43 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:10:43 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:43 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.789s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:43 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:10:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Deleted volume successfully. Jun 29 03:10:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ede8a98b-bf90-44cb-b7b3-387bc990ebc6 tempest-VolumeAndVolumeTypeFromImageTest-1528973729 None] Lock "cinder-9e3ac179-53dd-43c9-b7f6-c5b200ca2384-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:10:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:46 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[30930f84-d93e-4821-ba53-3900c086b645]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:46 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:10:46 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-96fc18d0-cf81-4209-9d17-4980283c3000 req-9f9c0a99-add9-4ba3-88c8-9feeba47b818 tempest-AttachVolumeTestJSON-1890221435 None] Terminate volume connection completed successfully. Jun 29 03:10:46 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-96fc18d0-cf81-4209-9d17-4980283c3000 req-9f9c0a99-add9-4ba3-88c8-9feeba47b818 tempest-AttachVolumeTestJSON-1890221435 None] Deleting attachment 89545ff9-b44a-420f-8a02-1acfc6d85b6e. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:10:47 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 0 in 1.313s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:47 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:10:47 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:48 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 1 in 1.190s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.573s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Flow 'volume_create_manager' (eb55e838-311f-4fe8-a70e-1cce4f6c2d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff569e6e-6b51-464f-9e38-a88d34c5a08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff569e6e-6b51-464f-9e38-a88d34c5a08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1700054906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aca7ca-e4d1-4f3c-9501-18d8b094e31b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82f331922bb544f39b06427fff4691e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:48Z,use_quota=True,user_id='3878c27009ff40959af812a537f83230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d134fc9d-fe12-4d8d-8ae5-726213aad2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d134fc9d-fe12-4d8d-8ae5-726213aad2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f6fb03-ca62-41dc-a3c0-6868e6bb7615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f6fb03-ca62-41dc-a3c0-6868e6bb7615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91aca7ca-e4d1-4f3c-9501-18d8b094e31b', 'volume_name': 'volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27060a53-ab5e-4d30-93a1-b7f864123533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27060a53-ab5e-4d30-93a1-b7f864123533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a748b1-e482-4170-a917-b6daaa59ebff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:48 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Volume 91aca7ca-e4d1-4f3c-9501-18d8b094e31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b', 'volume_size': 1} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1700054906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aca7ca-e4d1-4f3c-9501-18d8b094e31b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82f331922bb544f39b06427fff4691e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:48Z,use_quota=True,user_id='3878c27009ff40959af812a537f83230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Creating volume 91aca7ca-e4d1-4f3c-9501-18d8b094e31b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:48 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:48 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b 1073741824 Jun 29 03:10:48 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-4021783b-ad33-4589-be05-f942900a6fdc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c80a85f9-a676-4710-9bcf-83dd54b3d853', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:10:48 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-35fa37d4-0968-4050-8714-b05060a2c6ff req-93ab7538-1876-4eab-928e-ce1828f3c767 tempest-TestInstancesWithCinderVolumes-1810863045 None] attachment_update completed successfully. Jun 29 03:10:49 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b 1073741824" returned: 0 in 1.158s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (b7fecebc-7be8-4719-ba25-eb649f56bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc53b04-9400-4b16-b5f6-319470e6116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc53b04-9400-4b16-b5f6-319470e6116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285075057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f4a41b-4cf9-45ea-9c9c-d9918954a9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:50Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c36d4e5-d484-42b1-ad37-daef9ef2f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:49 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b Jun 29 03:10:49 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c36d4e5-d484-42b1-ad37-daef9ef2f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c46770b-df11-46d9-b346-57bec3e99943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c46770b-df11-46d9-b346-57bec3e99943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f4a41b-4cf9-45ea-9c9c-d9918954a9ea', 'volume_name': 'volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0d6eea-cb16-4316-b42c-9b814a72c7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0d6eea-cb16-4316-b42c-9b814a72c7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54fcec3-2dd6-4a06-802e-b9547f481ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume 95f4a41b-4cf9-45ea-9c9c-d9918954a9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea', 'volume_size': 1} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:50 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b" returned: 0 in 0.775s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285075057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f4a41b-4cf9-45ea-9c9c-d9918954a9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:50Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating volume 95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:50 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a748b1-e482-4170-a917-b6daaa59ebff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de110b6-e51b-46e0-a4e7-64a34cfa9e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:50 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea 1073741824 Jun 29 03:10:50 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:50 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Volume volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b (91aca7ca-e4d1-4f3c-9501-18d8b094e31b): created successfully Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de110b6-e51b-46e0-a4e7-64a34cfa9e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Flow 'volume_create_manager' (eb55e838-311f-4fe8-a70e-1cce4f6c2d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:50 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f2a7e788-6120-4184-98ba-b5484284f04e tempest-VolumesListTestJSON-1961570883 None] Created volume successfully. Jun 29 03:10:51 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea 1073741824" returned: 0 in 0.882s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:51 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea Jun 29 03:10:51 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Flow 'volume_create_manager' (47402325-3c5d-4d36-ba71-8ef4b19d8fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51848f13-aabc-4bcf-8769-90f9e8037f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:52 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51848f13-aabc-4bcf-8769-90f9e8037f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249597801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada1ec1b-c36e-4967-b007-bf508945dc35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82f331922bb544f39b06427fff4691e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:52Z,use_quota=True,user_id='3878c27009ff40959af812a537f83230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee456c2-6acd-4faf-a678-d2e7372bfb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee456c2-6acd-4faf-a678-d2e7372bfb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069ec629-4e70-46c7-93c6-f5967923cfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (069ec629-4e70-46c7-93c6-f5967923cfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada1ec1b-c36e-4967-b007-bf508945dc35', 'volume_name': 'volume-ada1ec1b-c36e-4967-b007-bf508945dc35', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439e365-d8a5-40bc-a304-a9dc50ac4d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9439e365-d8a5-40bc-a304-a9dc50ac4d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737b47ca-4121-45ba-a366-2b02b6e16c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:52 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Volume ada1ec1b-c36e-4967-b007-bf508945dc35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada1ec1b-c36e-4967-b007-bf508945dc35', 'volume_size': 1} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" returned: 0 in 0.837s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-249597801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada1ec1b-c36e-4967-b007-bf508945dc35,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82f331922bb544f39b06427fff4691e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:52Z,use_quota=True,user_id='3878c27009ff40959af812a537f83230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Creating volume ada1ec1b-c36e-4967-b007-bf508945dc35 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:10:52 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54fcec3-2dd6-4a06-802e-b9547f481ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:52 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 1073741824 Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02627d80-ba10-4024-8fa7-8d425115e2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:52 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:52 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea (95f4a41b-4cf9-45ea-9c9c-d9918954a9ea): created successfully Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02627d80-ba10-4024-8fa7-8d425115e2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (b7fecebc-7be8-4719-ba25-eb649f56bc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6f6ed9b6-759e-4500-88e1-5aff974163fa tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created volume successfully. Jun 29 03:10:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:53 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 1073741824" returned: 0 in 0.937s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:53 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 Jun 29 03:10:53 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:54 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35" returned: 0 in 0.704s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.892s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating offline snapshot 05293e8d-3c1b-4add-b078-3bc55a3264a9 of volume 95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (737b47ca-4121-45ba-a366-2b02b6e16c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada1ec1b-c36e-4967-b007-bf508945dc35', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef0fe92-b083-4ac8-94dc-0eff189b64f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f68839-7b0c-4270-ba94-6b67ef619ee7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:54 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Volume volume-ada1ec1b-c36e-4967-b007-bf508945dc35 (ada1ec1b-c36e-4967-b007-bf508945dc35): created successfully Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fef0fe92-b083-4ac8-94dc-0eff189b64f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Flow 'volume_create_manager' (47402325-3c5d-4d36-ba71-8ef4b19d8fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9f61d112-6191-4c3d-9c8c-90bb9d156249 tempest-VolumesListTestJSON-1961570883 None] Created volume successfully. Jun 29 03:10:54 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea Jun 29 03:10:54 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Flow 'volume_create_manager' (9591b9b2-e1b5-4553-b272-8bec381f3178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4136d6-7b6c-4eae-97f1-9f8aea387750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:55 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" returned: 0 in 1.691s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4136d6-7b6c-4eae-97f1-9f8aea387750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-632185355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75accac-2f40-44f5-9ffa-2324956e2454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82f331922bb544f39b06427fff4691e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:56Z,use_quota=True,user_id='3878c27009ff40959af812a537f83230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ec42c2-d242-443d-8b27-b4eb6f0d44d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ec42c2-d242-443d-8b27-b4eb6f0d44d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1103ce-dc15-4d1e-8bf0-d31bfbcea0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1103ce-dc15-4d1e-8bf0-d31bfbcea0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75accac-2f40-44f5-9ffa-2324956e2454', 'volume_name': 'volume-b75accac-2f40-44f5-9ffa-2324956e2454', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0110ef16-e148-432b-8756-a86014f84ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0110ef16-e148-432b-8756-a86014f84ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32df13be-b2b6-4867-8a0f-1b59441c4a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:10:55 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Volume b75accac-2f40-44f5-9ffa-2324956e2454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75accac-2f40-44f5-9ffa-2324956e2454', 'volume_size': 1} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:10:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:56 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 1G Jun 29 03:10:56 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:56 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 1G" returned: 0 in 0.948s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:56 devstack sudo[104917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 Jun 29 03:10:56 devstack sudo[104917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:57 devstack sudo[104917]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9" returned: 0 in 0.911s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:57 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 is being set with open permissions: ugo+rw Jun 29 03:10:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:57 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 Jun 29 03:10:57 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:58 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9" returned: 0 in 0.730s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:58 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info Jun 29 03:10:58 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:10:59 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jun 29 03:10:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info" returned: 0 in 0.815s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:10:59 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info is being set with open permissions: ugo+rw Jun 29 03:10:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:10:59 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info Jun 29 03:10:59 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:00 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.info" returned: 0 in 0.758s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.054s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.243s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-632185355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75accac-2f40-44f5-9ffa-2324956e2454,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='82f331922bb544f39b06427fff4691e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:10:56Z,use_quota=True,user_id='3878c27009ff40959af812a537f83230',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Creating volume b75accac-2f40-44f5-9ffa-2324956e2454 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:00 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:00 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 1073741824 Jun 29 03:11:00 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-fdde50c1-4d7c-43aa-8c03-a5d3c95a8402 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Create snapshot completed successfully Jun 29 03:11:01 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:11:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (26f73aa4-55de-438f-bdde-65964769f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a5567-c405-4d05-84d1-18aeeafad937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (585a5567-c405-4d05-84d1-18aeeafad937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830417505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8294abbb-d47f-4c1f-bce6-d7bd35bb5e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:02Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5584b865-06a9-4d61-8d16-bd99477d30ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5584b865-06a9-4d61-8d16-bd99477d30ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0372448c-25d2-4c32-a9b5-8e865b55e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0372448c-25d2-4c32-a9b5-8e865b55e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8294abbb-d47f-4c1f-bce6-d7bd35bb5e19', 'volume_name': 'volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:02 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a122e0e4-7a76-4392-a868-c18a8b533830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a122e0e4-7a76-4392-a868-c18a8b533830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ef233b-e3be-4c25-87d7-3be1ebaa3103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume 8294abbb-d47f-4c1f-bce6-d7bd35bb5e19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19', 'volume_size': 1} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 1073741824" returned: 0 in 2.190s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:02 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 Jun 29 03:11:02 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (20d6a2d9-8886-4686-a41c-3fae4ff2b5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafb0bd1-5995-4d97-bba9-214d9e2991d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafb0bd1-5995-4d97-bba9-214d9e2991d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882632354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:03Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51431a4c-e721-45a6-9d2b-0358f04ef87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51431a4c-e721-45a6-9d2b-0358f04ef87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1204e935-5647-4105-bef3-566c3aa493fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1204e935-5647-4105-bef3-566c3aa493fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088', 'volume_name': 'volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6ab643-b1c7-4654-a62e-d4109179dd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d6ab643-b1c7-4654-a62e-d4109179dd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda8b654-ec52-4bf7-9fd2-b2027e126d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:03 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088', 'volume_size': 1} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:11:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (7da3a3ed-f1d9-4cb3-bd11-1546270f2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17c56db-a31b-489b-b0a4-36bbc238f668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17c56db-a31b-489b-b0a4-36bbc238f668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-545580189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:04Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c359cb-5b34-4289-9eff-3d481f266577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c359cb-5b34-4289-9eff-3d481f266577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8ea178-b0a8-465b-9636-9e343e8f956f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8ea178-b0a8-465b-9636-9e343e8f956f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd', 'volume_name': 'volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2f27ea-562c-48a2-86b3-bb45ed588004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac2f27ea-562c-48a2-86b3-bb45ed588004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc6ddd2-d51f-499f-a982-25c87471ae21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd', 'volume_size': 1} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:04 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454" returned: 0 in 1.923s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] <== create_volume: return (4322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.336s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.194s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830417505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8294abbb-d47f-4c1f-bce6-d7bd35bb5e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:02Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating volume 8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:04 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32df13be-b2b6-4867-8a0f-1b59441c4a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75accac-2f40-44f5-9ffa-2324956e2454', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d5223a-9578-4f90-9c27-f6e22676154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Volume volume-b75accac-2f40-44f5-9ffa-2324956e2454 (b75accac-2f40-44f5-9ffa-2324956e2454): created successfully Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d5223a-9578-4f90-9c27-f6e22676154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:04 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 1073741824 Jun 29 03:11:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Flow 'volume_create_manager' (9591b9b2-e1b5-4553-b272-8bec381f3178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:04 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ea87629f-ab15-40cc-a305-0f12328cee68 tempest-VolumesListTestJSON-1961570883 None] Created volume successfully. Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (262bdad9-d941-44fc-b401-91c2182d5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13b1a47-ad22-4a21-a8dc-6c0accbca35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13b1a47-ad22-4a21-a8dc-6c0accbca35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736878338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93b1eec-e60b-499d-bc88-2bc510616ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:06Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85350514-1be8-46b1-b989-a86fb6dc340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85350514-1be8-46b1-b989-a86fb6dc340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e447a3-8b17-4142-bc8b-f183ef5be47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e447a3-8b17-4142-bc8b-f183ef5be47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93b1eec-e60b-499d-bc88-2bc510616ff4', 'volume_name': 'volume-b93b1eec-e60b-499d-bc88-2bc510616ff4', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053dda46-ee90-4a51-960e-6b01a13a9435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053dda46-ee90-4a51-960e-6b01a13a9435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f45b9bc-84dc-4081-8417-86321d34b55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume b93b1eec-e60b-499d-bc88-2bc510616ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93b1eec-e60b-499d-bc88-2bc510616ff4', 'volume_size': 1} Jun 29 03:11:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (fea9fc50-0e6a-4f07-8dc4-2b362df8b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16dba5b-b827-4d89-96ac-d43dda9b5a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16dba5b-b827-4d89-96ac-d43dda9b5a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86493792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132e0ac5-f73e-4f4f-9615-de1d46e4ac97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:07Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1814eb32-1e8d-44e1-84e8-c67a0a8e9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1814eb32-1e8d-44e1-84e8-c67a0a8e9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a0f408-afea-4563-8906-a427dae51e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a0f408-afea-4563-8906-a427dae51e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132e0ac5-f73e-4f4f-9615-de1d46e4ac97', 'volume_name': 'volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdc88b0-cf82-485a-a586-22d05a229cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afdc88b0-cf82-485a-a586-22d05a229cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d5033e-a9ad-4a66-a415-b320ac93d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:07 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume 132e0ac5-f73e-4f4f-9615-de1d46e4ac97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97', 'volume_size': 1} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:07 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 1073741824" returned: 0 in 2.979s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:07 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 Jun 29 03:11:07 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:09 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19" returned: 0 in 1.499s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] <== create_volume: return (4601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.623s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.744s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1882632354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:03Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating volume c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:09 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:09 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 1073741824 Jun 29 03:11:09 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7ef233b-e3be-4c25-87d7-3be1ebaa3103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acc6714-eee2-47d5-8c75-a2a02ba8069e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:09 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 (8294abbb-d47f-4c1f-bce6-d7bd35bb5e19): created successfully Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6acc6714-eee2-47d5-8c75-a2a02ba8069e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (26f73aa4-55de-438f-bdde-65964769f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f37d9d14-17b2-4cd5-8509-635ae0e63619 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created volume successfully. Jun 29 03:11:10 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 1073741824" returned: 0 in 1.168s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:10 devstack sudo[105071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 Jun 29 03:11:10 devstack sudo[105071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:11 devstack sudo[105071]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088" returned: 0 in 1.092s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.365s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.389s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-545580189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:04Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating volume a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:11 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda8b654-ec52-4bf7-9fd2-b2027e126d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379fe87c-d505-4fd0-a7c5-e0b7b9e56688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:11 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd 1073741824 Jun 29 03:11:11 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:11 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 (c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088): created successfully Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379fe87c-d505-4fd0-a7c5-e0b7b9e56688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (20d6a2d9-8886-4686-a41c-3fae4ff2b5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:11 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6c0c9221-903b-438a-aef0-77a3785f1c7d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created volume successfully. Jun 29 03:11:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "cinder-b75accac-2f40-44f5-9ffa-2324956e2454-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-b75accac-2f40-44f5-9ffa-2324956e2454-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "cinder-quobyte-b75accac-2f40-44f5-9ffa-2324956e2454" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-quobyte-b75accac-2f40-44f5-9ffa-2324956e2454" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:12 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e09703e-3838-4c4a-8847-bd16b8873e79]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:12 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 Jun 29 03:11:12 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:13 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd 1073741824" returned: 0 in 1.462s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:13 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd Jun 29 03:11:13 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:13 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454" returned: 0 in 1.337s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:14 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:14 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454 Jun 29 03:11:14 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.325s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1736878338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93b1eec-e60b-499d-bc88-2bc510616ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:06Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating volume b93b1eec-e60b-499d-bc88-2bc510616ff4 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:14 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cc6ddd2-d51f-499f-a982-25c87471ae21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:14 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 1073741824 Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2e3e12-253b-4034-99a1-6d2da35ced45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:14 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:14 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd (a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd): created successfully Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2e3e12-253b-4034-99a1-6d2da35ced45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (7da3a3ed-f1d9-4cb3-bd11-1546270f2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-243d4c58-4ee6-4fc1-a740-0ba52cadd7ef tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created volume successfully. Jun 29 03:11:14 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b75accac-2f40-44f5-9ffa-2324956e2454" returned: 0 in 0.986s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-quobyte-b75accac-2f40-44f5-9ffa-2324956e2454" released by "delete_volume" :: held 2.396s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Created reservations ['7ffc7400-e51b-4bae-b837-80491bb0010d', '24bc568c-6a1a-48a7-9608-7ad2b1b918d2', 'dc92c02d-a371-493d-a662-5484dbf7eb43', '291801c4-ac30-4da4-a9ac-13d6427267cb'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:15 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:15 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:15 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 1073741824" returned: 0 in 1.173s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:15 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 Jun 29 03:11:15 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:15 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.721s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:15 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Deleted volume successfully. Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4712e276-5078-42fb-9456-d7a50a89e587 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-b75accac-2f40-44f5-9ffa-2324956e2454-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:15 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "cinder-ada1ec1b-c36e-4967-b007-bf508945dc35-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4" returned: 0 in 0.733s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.699s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86493792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132e0ac5-f73e-4f4f-9615-de1d46e4ac97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3507d20c5843febd5cd63638ce8b2b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:07Z,use_quota=True,user_id='ebc54180445c4bfabf0627dcfe46359c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Creating volume 132e0ac5-f73e-4f4f-9615-de1d46e4ac97 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:16 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-ada1ec1b-c36e-4967-b007-bf508945dc35-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:16 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 1073741824 Jun 29 03:11:16 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f45b9bc-84dc-4081-8417-86321d34b55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93b1eec-e60b-499d-bc88-2bc510616ff4', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f37fad4-ab4f-4c29-9616-37a7aaca1bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:16 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 (b93b1eec-e60b-499d-bc88-2bc510616ff4): created successfully Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f37fad4-ab4f-4c29-9616-37a7aaca1bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (262bdad9-d941-44fc-b401-91c2182d5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-15b41c11-55af-4915-8ec5-c3a4e3181a61 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created volume successfully. Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "cinder-quobyte-ada1ec1b-c36e-4967-b007-bf508945dc35" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-quobyte-ada1ec1b-c36e-4967-b007-bf508945dc35" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab3033a-0c56-4a01-ba3f-ab915b3bbb4b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:16 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 Jun 29 03:11:16 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:16 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 1073741824" returned: 0 in 0.880s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:16 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 Jun 29 03:11:16 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:17 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35" returned: 0 in 0.833s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:17 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35 Jun 29 03:11:17 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:17 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:17 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:17 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97" returned: 0 in 0.752s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20d5033e-a9ad-4a66-a415-b320ac93d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9fce01-b16e-47fd-9a6c-b859344573c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:17 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ada1ec1b-c36e-4967-b007-bf508945dc35" returned: 0 in 0.728s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Volume volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 (132e0ac5-f73e-4f4f-9615-de1d46e4ac97): created successfully Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9fce01-b16e-47fd-9a6c-b859344573c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Flow 'volume_create_manager' (fea9fc50-0e6a-4f07-8dc4-2b362df8b628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-quobyte-ada1ec1b-c36e-4967-b007-bf508945dc35" released by "delete_volume" :: held 1.625s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8a2c2876-6654-49dd-8667-227f81908d59 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created volume successfully. Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:DELETE=11,cinder:UPDATE=76,cinder:SELECT=87,cinder:INSERT=22 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Created reservations ['0e837f08-8b83-4784-b1c4-3fe7f920c25c', 'd9fb674d-fe96-4ece-a105-16e1a6a5eccd', 'ff3a139a-bd9f-4a92-8cf9-7c0407236781', '629241d0-b7ff-44f2-83df-449aac0311a6'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:17 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:17 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-132e0ac5-f73e-4f4f-9615-de1d46e4ac97-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-132e0ac5-f73e-4f4f-9615-de1d46e4ac97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-132e0ac5-f73e-4f4f-9615-de1d46e4ac97" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-132e0ac5-f73e-4f4f-9615-de1d46e4ac97" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ca7757-4500-4de4-bb88-51dcc701bc9f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "cinder-91aca7ca-e4d1-4f3c-9501-18d8b094e31b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-91aca7ca-e4d1-4f3c-9501-18d8b094e31b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "cinder-quobyte-91aca7ca-e4d1-4f3c-9501-18d8b094e31b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-quobyte-91aca7ca-e4d1-4f3c-9501-18d8b094e31b" acquired by "delete_volume" :: waited 0.041s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:18 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 Jun 29 03:11:18 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[97784ce4-79c0-433c-a628-9cbc2859dd41]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:18 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.041s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:11:18 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b Jun 29 03:11:18 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:18 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.001s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:18 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Deleted volume successfully. Jun 29 03:11:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-433c9438-46fd-49c4-b82a-1fa2d9df78c9 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-ada1ec1b-c36e-4967-b007-bf508945dc35-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:19 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97" returned: 0 in 0.925s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:19 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97 Jun 29 03:11:19 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:19 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b" returned: 0 in 0.920s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:19 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b Jun 29 03:11:19 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:20 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-132e0ac5-f73e-4f4f-9615-de1d46e4ac97" returned: 0 in 0.757s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-132e0ac5-f73e-4f4f-9615-de1d46e4ac97" released by "delete_volume" :: held 1.736s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['af0f1bef-dd83-4fdb-8425-3fdb25e3aad4', '44b58e7d-5ec3-4b0a-ba93-f82268dc340a', 'c5e92124-8364-44e1-ac6b-a9e3f1837106', '1153309a-6433-4f36-a356-97883a087b1d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:20 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91aca7ca-e4d1-4f3c-9501-18d8b094e31b" returned: 0 in 0.674s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-quobyte-91aca7ca-e4d1-4f3c-9501-18d8b094e31b" released by "delete_volume" :: held 1.653s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:20 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:20 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Created reservations ['e7038a26-c539-43f2-93b4-16ca95119df6', '8b2d8bd2-a43f-4e30-803b-f771836d8b44', '6841c3cd-6b0e-4009-98dd-7542a1555369', '48a3cf76-7c6d-4e47-88c6-4eddf06e7b7d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:20 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:20 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-b93b1eec-e60b-499d-bc88-2bc510616ff4-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-b93b1eec-e60b-499d-bc88-2bc510616ff4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-b93b1eec-e60b-499d-bc88-2bc510616ff4" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-b93b1eec-e60b-499d-bc88-2bc510616ff4" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d72cf-6b4f-4bb4-935b-ccbcafed9b79]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:20 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 Jun 29 03:11:20 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:20 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.694s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleted volume successfully. Jun 29 03:11:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c55fe0fe-7a6e-454e-a24a-13b3527535ac tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-132e0ac5-f73e-4f4f-9615-de1d46e4ac97-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:21 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.833s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:21 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Deleted volume successfully. Jun 29 03:11:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d0f27675-b7b0-41b5-be32-b064d96d9319 tempest-VolumesListTestJSON-1961570883 None] Lock "cinder-91aca7ca-e4d1-4f3c-9501-18d8b094e31b-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:21 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4" returned: 0 in 0.933s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:21 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4 Jun 29 03:11:21 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:22 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b93b1eec-e60b-499d-bc88-2bc510616ff4" returned: 0 in 0.829s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-b93b1eec-e60b-499d-bc88-2bc510616ff4" released by "delete_volume" :: held 1.810s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['e657ae47-4299-4af2-9dff-0c28d7c16d37', '6d0de91e-edfd-4d9d-b8c5-3a4f5301c05c', 'c424e0b9-3aa4-42ea-8b22-daa9fccf4e29', 'd46e7917-4675-4b12-9d3e-6f05310a45a0'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:22 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:22 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e788b08e-eff3-4a8f-971c-5191bdcd82f0]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:23 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd Jun 29 03:11:23 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:23 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.813s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:23 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:23 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleted volume successfully. Jun 29 03:11:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b531389e-e0d6-47f7-b2ef-a19c9fb11e5c tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-b93b1eec-e60b-499d-bc88-2bc510616ff4-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:23 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd" returned: 0 in 0.924s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:23 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd Jun 29 03:11:23 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Flow 'volume_create_manager' (688a943c-0ce1-4db9-82cd-c3a972ec18fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb98af2-e20a-441c-b42d-97f9863eeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb98af2-e20a-441c-b42d-97f9863eeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1780657827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa97d9df-1d6a-4a8c-a424-5c10b557d1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f8233598ad47988bf28fb85ac7a776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:24Z,use_quota=True,user_id='154af0fea25443398976339ff129d0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e434b5c-9506-45fa-94d5-fe2f08b8c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e434b5c-9506-45fa-94d5-fe2f08b8c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406a2d51-4e1e-40be-a251-e573bc5d55c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406a2d51-4e1e-40be-a251-e573bc5d55c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa97d9df-1d6a-4a8c-a424-5c10b557d1f5', 'volume_name': 'volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1408c221-5bce-458e-a4a8-2c71dc3ad246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1408c221-5bce-458e-a4a8-2c71dc3ad246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e42f6e-1e01-4e79-9125-0b6eb4182540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:24 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Volume fa97d9df-1d6a-4a8c-a424-5c10b557d1f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5', 'volume_size': 1} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1780657827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa97d9df-1d6a-4a8c-a424-5c10b557d1f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f8233598ad47988bf28fb85ac7a776',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:11:24Z,use_quota=True,user_id='154af0fea25443398976339ff129d0af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Creating volume fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:11:24 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:24 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 1073741824 Jun 29 03:11:24 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:24 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd" released by "delete_volume" :: held 1.715s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['127e1548-a25d-4179-ba89-e612572d4d6b', 'e8c04d75-4000-439f-ba7f-6c0f65cef88b', '118a07cb-da48-4e62-9f78-f13d2f913cb7', '43af9975-6f1a-49d4-bd6f-37e110298b2d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:24 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:24 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964c1fd-626a-4a87-8206-ad0f191bdf88]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:25 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 Jun 29 03:11:25 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:25 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 1073741824" returned: 0 in 0.917s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:25 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.703s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:25 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleted volume successfully. Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-843461bd-4908-43b4-8c74-8a5eb7e58416 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-a7921f3d-b9c9-4d0f-8a7b-efc00ed16abd-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:25 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 Jun 29 03:11:25 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:26 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:26 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088 Jun 29 03:11:26 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:26 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5" returned: 0 in 0.658s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e42f6e-1e01-4e79-9125-0b6eb4182540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5498c2ac-779e-4e26-8481-601f5984d588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:11:26 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Volume volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 (fa97d9df-1d6a-4a8c-a424-5c10b557d1f5): created successfully Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5498c2ac-779e-4e26-8481-601f5984d588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Flow 'volume_create_manager' (688a943c-0ce1-4db9-82cd-c3a972ec18fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:11:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-882768dc-7af1-451a-bf3d-f0264ddbcad1 tempest-VolumesNegativeTest-1549069841 None] Created volume successfully. Jun 29 03:11:26 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088" returned: 0 in 0.698s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088" released by "delete_volume" :: held 1.557s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['1f867b53-115d-4463-a8b4-5a2cdd65ddbc', '3606bacb-ec28-4532-9f8e-ce2c5dc42c78', '920119f9-204a-4338-8639-864aaf2454a8', '5857bda2-6aca-45f1-9e75-0bda75d42458'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:26 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:26 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0537eef2-e1fe-43f0-b968-a9fd45223c3a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:27 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 Jun 29 03:11:27 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:28 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.138s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleted volume successfully. Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cb027fd6-4496-4819-ab63-b45dfcbbd3f8 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-c80c4e69-bcaf-40d1-9ff4-7a2ef60f8088-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f96612-8dbe-4fb4-8532-dee9ae7dabbe]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:28 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 Jun 29 03:11:28 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:28 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19" returned: 0 in 0.899s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:28 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19 Jun 29 03:11:28 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:28 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31" returned: 0 in 0.871s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a32d7075-e1f2-4c12-a938-456243eaed77', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:11:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-eb592556-8b20-4fa6-b70a-8e8289452bc9 req-dc7446c0-77b4-430c-b45d-57cdd125c281 tempest-TestInstancesWithCinderVolumes-1810863045 None] attachment_update completed successfully. Jun 29 03:11:29 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19" returned: 0 in 0.693s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19" released by "delete_volume" :: held 1.640s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['cc2b0bf2-8abd-438f-be7a-f814a59bad81', 'cae5f752-8b22-4bfb-b144-5de8d58e73dc', '3e6ffcef-6d71-4226-9ede-80df193540d7', '58420a20-ed03-4c8c-819a-da291756c55b'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:29 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:29 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-05293e8d-3c1b-4add-b078-3bc55a3264a9-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-05293e8d-3c1b-4add-b078-3bc55a3264a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-05293e8d-3c1b-4add-b078-3bc55a3264a9" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-05293e8d-3c1b-4add-b078-3bc55a3264a9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleting offline snapshot 05293e8d-3c1b-4add-b078-3bc55a3264a9 of volume 95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] snapshot_file for this snap is: volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259df88-17f9-4383-abbc-a6b7b91f9468]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:29 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 Jun 29 03:11:29 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:30 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.766s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:30 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleted volume successfully. Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-156885fa-068a-406c-9128-8c47b7feb675 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-8294abbb-d47f-4c1f-bce6-d7bd35bb5e19-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:30 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9" returned: 0 in 0.869s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c394de4-199a-41f5-91bd-5f5793cf108a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:30 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea Jun 29 03:11:30 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:31 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" returned: 0 in 1.069s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:31 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 Jun 29 03:11:31 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:32 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9" returned: 0 in 0.782s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:32 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9 Jun 29 03:11:32 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:33 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea.05293e8d-3c1b-4add-b078-3bc55a3264a9" returned: 0 in 0.913s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-05293e8d-3c1b-4add-b078-3bc55a3264a9" released by "_delete_snapshot" :: held 3.749s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" released by "delete_snapshot" :: held 3.776s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:33 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['6d9beeff-6541-46a7-8f94-45ac133b9c55', '7de7abf2-75f1-459f-bdf7-db21a9c6eaf5', 'bf71991f-3af4-4c13-9cfd-e5e2e038b3d8', 'f115984a-3af1-4513-bfd2-fda4512644b9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Delete snapshot completed successfully. Jun 29 03:11:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ee767da8-af92-40f8-be53-a9b45bbb4af6 tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-05293e8d-3c1b-4add-b078-3bc55a3264a9-delete_snapshot" released by "delete_snapshot" :: held 3.939s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "cinder-quobyte-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae72723b-10b8-4438-99a2-e875de8bc637]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:34 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea Jun 29 03:11:34 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:35 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" returned: 0 in 0.971s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:35 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea Jun 29 03:11:35 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:35 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" returned: 0 in 0.787s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-quobyte-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea" released by "delete_volume" :: held 1.858s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Created reservations ['63295e02-9e6d-47bd-968f-2141e9ea443b', 'e8b52d2a-0f5d-4e26-bf3d-5de34afed591', 'f02a135b-a0de-42a2-9f53-6a0e6498c170', '495a835c-66c8-4e9d-b3fe-d58a3d555388'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:36 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:36 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:36 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.751s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Deleted volume successfully. Jun 29 03:11:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-968d2136-d77c-44a2-8d54-24b97b3a331d tempest-CreateVolumesFromSnapshotTest-2091185914 None] Lock "cinder-95f4a41b-4cf9-45ea-9c9c-d9918954a9ea-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409be86-a77a-4870-8cb5-4bc2e2366e36]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:38 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 Jun 29 03:11:38 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:38 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3" returned: 0 in 0.974s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c7e02dc-057b-4254-b6c8-d3bee9df471a', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:11:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-749f84bd-f3a6-442d-af70-491c80dae6ba req-1fe43bc6-b00c-4e0d-9433-2dbff2c15b07 tempest-TestInstancesWithCinderVolumes-1810863045 None] attachment_update completed successfully. Jun 29 03:11:48 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=76,cinder:SELECT=53,cinder:DELETE=5,cinder:INSERT=15 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:11:48 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=124,cinder:SELECT=91,cinder:DELETE=11,cinder:INSERT=30 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:11:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-eda6aa01-7eab-45b4-a869-4085fca4927d req-4861ff36-de0e-400f-8bd6-b20cd503bbdb tempest-TestInstancesWithCinderVolumes-1810863045 None] Terminate volume connection completed successfully. Jun 29 03:11:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-eda6aa01-7eab-45b4-a869-4085fca4927d req-4861ff36-de0e-400f-8bd6-b20cd503bbdb tempest-TestInstancesWithCinderVolumes-1810863045 None] Deleting attachment a32d7075-e1f2-4c12-a938-456243eaed77. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:11:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "cinder-92f0a9df-0a76-471a-b48a-c7f7ee960a31-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-92f0a9df-0a76-471a-b48a-c7f7ee960a31-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "cinder-quobyte-92f0a9df-0a76-471a-b48a-c7f7ee960a31" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:11:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-quobyte-92f0a9df-0a76-471a-b48a-c7f7ee960a31" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:11:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[92db3791-5f8c-4593-a844-a4a7107bbe68]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:11:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:51 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 Jun 29 03:11:51 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:52 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31" returned: 0 in 0.840s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:52 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31 Jun 29 03:11:52 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:53 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-92f0a9df-0a76-471a-b48a-c7f7ee960a31" returned: 0 in 0.775s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-quobyte-92f0a9df-0a76-471a-b48a-c7f7ee960a31" released by "delete_volume" :: held 1.659s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:53 devstack cinder-volume[93518]: WARNING cinder.quota [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1368785139-1385790304 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1368785139-1385790304, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:11:53 devstack cinder-volume[93518]: WARNING cinder.quota [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1368785139-1385790304 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1368785139-1385790304, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Created reservations ['116dd7e6-3f50-4274-a48a-154ef9294c7b', '7c726e5e-e57d-4164-9d20-5a023fdd3c0d', 'b45c8a79-be4e-4b75-9d4f-8a7702c66ecd', 'ccf2a8f1-6019-4b18-9825-2336089a2aa1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:11:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:11:53 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:11:53 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:11:53 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Jun 29 03:11:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.762s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:11:54 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:11:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deleted volume successfully. Jun 29 03:11:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8db5cfcc-c148-43fd-9063-e19e9afa2c24 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-92f0a9df-0a76-471a-b48a-c7f7ee960a31-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:11:58 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-82e2596f-376c-4b7e-a0bc-c460a197f485 req-1ebb99cb-b7dd-4b78-b3fb-22508d5422c8 tempest-TestInstancesWithCinderVolumes-1810863045 None] Terminate volume connection completed successfully. Jun 29 03:11:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-82e2596f-376c-4b7e-a0bc-c460a197f485 req-1ebb99cb-b7dd-4b78-b3fb-22508d5422c8 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deleting attachment 0c7e02dc-057b-4254-b6c8-d3bee9df471a. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Acquiring lock "cinder-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Lock "cinder-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Acquiring lock "cinder-quobyte-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Lock "cinder-quobyte-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8e8ad4-ecd8-4213-b34b-efcd69d15f6f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:00 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 Jun 29 03:12:00 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "cinder-a41ce92e-9ac2-4680-a735-d3d059ced4f3-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-a41ce92e-9ac2-4680-a735-d3d059ced4f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "cinder-quobyte-a41ce92e-9ac2-4680-a735-d3d059ced4f3" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-quobyte-a41ce92e-9ac2-4680-a735-d3d059ced4f3" acquired by "delete_volume" :: waited 0.034s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:01 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c176682a-b105-41e2-889a-34ebaab7fe94]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:01 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 Jun 29 03:12:01 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:01 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5" returned: 0 in 1.219s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:01 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5 Jun 29 03:12:01 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:02 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3" returned: 0 in 1.074s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:02 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3 Jun 29 03:12:02 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:02 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5" returned: 0 in 0.732s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Lock "cinder-quobyte-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5" released by "delete_volume" :: held 2.013s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Created reservations ['a1f5a0a6-a050-4bb6-b74d-02ef798e7cc1', 'e5e2e522-1d81-4487-8a47-de8b529e1518', '00ebee2e-cebc-4d79-a88a-b4f1c8ff4073', '13f6c046-1586-478b-99bb-dd0c9cae1263'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:02 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:12:02 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:03 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a41ce92e-9ac2-4680-a735-d3d059ced4f3" returned: 0 in 0.862s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-quobyte-a41ce92e-9ac2-4680-a735-d3d059ced4f3" released by "delete_volume" :: held 2.010s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:03 devstack cinder-volume[93518]: WARNING cinder.quota [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395576683-23788593 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395576683-23788593, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:12:03 devstack cinder-volume[93518]: WARNING cinder.quota [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395576683-23788593 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-395576683-23788593, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Created reservations ['5c9e928a-2cfd-4728-98c2-e9330d9a52e3', '19f6085c-cd82-438d-8b64-9f8deb498e31', 'c21e1e60-798a-4902-a2a7-e37eced80e20', '5ee87dbd-72c9-455b-b9b3-e7f416d7e581'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:03 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:12:03 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:03 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.893s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:12:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Deleted volume successfully. Jun 29 03:12:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0c62d57e-31a1-4e4a-b520-c2dcc0e64e0f tempest-VolumesNegativeTest-1549069841 None] Lock "cinder-fa97d9df-1d6a-4a8c-a424-5c10b557d1f5-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:04 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.894s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:04 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:12:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deleted volume successfully. Jun 29 03:12:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9fd8c0a8-9b01-4ac7-b167-8dcd5429b713 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-a41ce92e-9ac2-4680-a735-d3d059ced4f3-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Flow 'volume_create_manager' (a7882a4d-0a19-46a4-8bb2-3a6c36e4dbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5dbf73-cb28-4de8-9b8c-58094fdf483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5dbf73-cb28-4de8-9b8c-58094fdf483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d3d5ef-03ae-4c3e-b643-4ed04bef98bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c262da4d4fb7471fa43662dcc9dc4478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:07Z,use_quota=True,user_id='ab901bd158dd4741aba2d0110c12d3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3195e7-8e4e-4af1-80e7-692a5c3922c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3195e7-8e4e-4af1-80e7-692a5c3922c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9921e684-c5de-4cfe-b73e-6ee2407d17f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9921e684-c5de-4cfe-b73e-6ee2407d17f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d3d5ef-03ae-4c3e-b643-4ed04bef98bf', 'volume_name': 'volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57ea19d-497b-4772-942e-dca100833546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57ea19d-497b-4772-942e-dca100833546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055210f-84dd-4a54-8264-abc6cf1602e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:07 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Volume 17d3d5ef-03ae-4c3e-b643-4ed04bef98bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf', 'volume_size': 1} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d3d5ef-03ae-4c3e-b643-4ed04bef98bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c262da4d4fb7471fa43662dcc9dc4478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:07Z,use_quota=True,user_id='ab901bd158dd4741aba2d0110c12d3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Creating volume 17d3d5ef-03ae-4c3e-b643-4ed04bef98bf {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:12:07 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:12:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:07 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf 1073741824 Jun 29 03:12:07 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:08 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf 1073741824" returned: 0 in 1.014s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:08 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf Jun 29 03:12:08 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:09 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf" returned: 0 in 0.752s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055210f-84dd-4a54-8264-abc6cf1602e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00821b2d-a516-487d-82ea-fa5b46ce9d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:09 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Volume volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf (17d3d5ef-03ae-4c3e-b643-4ed04bef98bf): created successfully Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00821b2d-a516-487d-82ea-fa5b46ce9d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Flow 'volume_create_manager' (a7882a4d-0a19-46a4-8bb2-3a6c36e4dbdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0525bef2-1a67-4990-b206-047f94d03546 tempest-CinderUnicodeTest-528281849 None] Created volume successfully. Jun 29 03:12:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-9445ac84-4c7e-4529-b465-20097e861141 req-eaa3764d-a71f-4447-93d3-7bdc14555e90 tempest-TestInstancesWithCinderVolumes-1810863045 None] Terminate volume connection completed successfully. Jun 29 03:12:09 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-9445ac84-4c7e-4529-b465-20097e861141 req-eaa3764d-a71f-4447-93d3-7bdc14555e90 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deleting attachment c80a85f9-a676-4710-9bcf-83dd54b3d853. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:12:10 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:12:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Flow 'volume_create_manager' (0f91beb9-4e26-48e2-bf12-7656e41e6d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ae69a9-9cb4-485e-a69c-f44d27a80454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4ae69a9-9cb4-485e-a69c-f44d27a80454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1034849115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb02cfc-4b88-471e-82d9-e1545088d384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c262da4d4fb7471fa43662dcc9dc4478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:11Z,use_quota=True,user_id='ab901bd158dd4741aba2d0110c12d3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee77b274-b7b0-4b01-be66-a5f7450c37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee77b274-b7b0-4b01-be66-a5f7450c37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f3a2a5-bbfd-4453-b352-128c301d9db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f3a2a5-bbfd-4453-b352-128c301d9db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdb02cfc-4b88-471e-82d9-e1545088d384', 'volume_name': 'volume-cdb02cfc-4b88-471e-82d9-e1545088d384', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535f4019-2412-455e-a4ce-74398760f6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (535f4019-2412-455e-a4ce-74398760f6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763d08c4-f0e2-4fbb-ada3-1e5002265e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:11 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Volume cdb02cfc-4b88-471e-82d9-e1545088d384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdb02cfc-4b88-471e-82d9-e1545088d384', 'volume_size': 1} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1034849115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdb02cfc-4b88-471e-82d9-e1545088d384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c262da4d4fb7471fa43662dcc9dc4478',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:11Z,use_quota=True,user_id='ab901bd158dd4741aba2d0110c12d3f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Creating volume cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:12:11 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:11 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 1073741824 Jun 29 03:12:11 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:11 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 1073741824" returned: 0 in 0.833s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:11 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 Jun 29 03:12:11 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:12 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (763d08c4-f0e2-4fbb-ada3-1e5002265e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdb02cfc-4b88-471e-82d9-e1545088d384', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe823295-e8ac-4dd2-825b-1d8a023f3c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:12 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Volume volume-cdb02cfc-4b88-471e-82d9-e1545088d384 (cdb02cfc-4b88-471e-82d9-e1545088d384): created successfully Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe823295-e8ac-4dd2-825b-1d8a023f3c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Flow 'volume_create_manager' (0f91beb9-4e26-48e2-bf12-7656e41e6d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-896f0a30-9f71-4631-be22-ad8fe901c23a tempest-CinderUnicodeTest-528281849 None] Created volume successfully. Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Creating offline snapshot 47abb3a5-6f82-4b4d-8f3c-3e174f475866 of volume cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee48f5-f883-41d7-acd2-3ec352a6086c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:13 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 Jun 29 03:12:13 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "cinder-4021783b-ad33-4589-be05-f942900a6fdc-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-4021783b-ad33-4589-be05-f942900a6fdc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "cinder-quobyte-4021783b-ad33-4589-be05-f942900a6fdc" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-quobyte-4021783b-ad33-4589-be05-f942900a6fdc" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a311c99c-5a35-475c-bf7c-d404716a46db]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:13 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:12:13 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:14 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384" returned: 0 in 0.821s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:14 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 1G Jun 29 03:12:14 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:14 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 0 in 0.819s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:14 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:12:14 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:14 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 1G" returned: 0 in 0.896s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb02cfc-4b88-471e-82d9-e1545088d384 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:15 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb02cfc-4b88-471e-82d9-e1545088d384 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 Jun 29 03:12:15 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:15 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 1 in 0.782s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:15 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc Jun 29 03:12:15 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:15 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cdb02cfc-4b88-471e-82d9-e1545088d384 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866" returned: 0 in 0.739s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:15 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 is being set with open permissions: ugo+rw Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:15 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 Jun 29 03:12:15 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:15 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4021783b-ad33-4589-be05-f942900a6fdc" returned: 0 in 0.738s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-quobyte-4021783b-ad33-4589-be05-f942900a6fdc" released by "delete_volume" :: held 2.409s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:16 devstack cinder-volume[93518]: WARNING cinder.quota [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024683-861426762 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024683-861426762, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:12:16 devstack cinder-volume[93518]: WARNING cinder.quota [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024683-861426762 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1563024683-861426762, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Created reservations ['f2ac99e5-c884-4f0d-b19a-437a506f4283', '8c5e27ec-2205-4de4-87a0-570c1f5714fe', '91642e66-2ca0-4bcc-8891-d66fae3b5161', '195b65ef-aa6c-489a-a00f-0a8f9bc49c4f'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:16 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:12:16 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:16 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866" returned: 0 in 0.667s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:16 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info Jun 29 03:12:16 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:16 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.734s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:12:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Deleted volume successfully. Jun 29 03:12:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-71c12014-7fa0-44f6-b002-c0003b21aa96 tempest-TestInstancesWithCinderVolumes-1810863045 None] Lock "cinder-4021783b-ad33-4589-be05-f942900a6fdc-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:17 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info" returned: 0 in 0.650s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:17 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info is being set with open permissions: ugo+rw Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:17 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info Jun 29 03:12:17 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:17 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:12:17 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:17 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.info" returned: 0 in 0.693s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d0f89956-486a-45c2-8dea-0dbbfa7a2d83 tempest-CinderUnicodeTest-528281849 None] Create snapshot completed successfully Jun 29 03:12:18 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.720s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-47abb3a5-6f82-4b4d-8f3c-3e174f475866-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-47abb3a5-6f82-4b4d-8f3c-3e174f475866-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-quobyte-cdb02cfc-4b88-471e-82d9-e1545088d384" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-cdb02cfc-4b88-471e-82d9-e1545088d384" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-quobyte-47abb3a5-6f82-4b4d-8f3c-3e174f475866" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-47abb3a5-6f82-4b4d-8f3c-3e174f475866" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Deleting offline snapshot 47abb3a5-6f82-4b4d-8f3c-3e174f475866 of volume cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] snapshot_file for this snap is: volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca492a0-3be9-49bf-8be6-dc866b87322c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:18 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 Jun 29 03:12:18 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:19 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866" returned: 0 in 0.812s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cdb02cfc-4b88-471e-82d9-e1545088d384(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:12:19 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbaa2ec-3367-42b8-aede-0cb41c19bf70]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:19 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 Jun 29 03:12:19 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:20 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384" returned: 0 in 0.956s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:20 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 Jun 29 03:12:20 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Flow 'volume_create_manager' (dc698739-f9eb-4cac-b657-13ebc5f513b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b39fa-f595-4283-adc0-d606a5697c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b39fa-f595-4283-adc0-d606a5697c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1720766330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7940c4-b79e-4ece-8dc5-82e4408328d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a3980f17ef4e24903e3835c068ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:21Z,use_quota=True,user_id='b2e82153f1444fe78af69e5ff0b3d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfb5f0c-e66e-4e97-b493-a248f116e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfb5f0c-e66e-4e97-b493-a248f116e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63012a13-8812-4e1b-a81d-a31dd26ac5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63012a13-8812-4e1b-a81d-a31dd26ac5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f7940c4-b79e-4ece-8dc5-82e4408328d2', 'volume_name': 'volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa85e447-a604-42b6-a615-70c104d16f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa85e447-a604-42b6-a615-70c104d16f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce564a32-c0ef-4308-a127-e294ae255860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:20 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Volume 7f7940c4-b79e-4ece-8dc5-82e4408328d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2', 'volume_size': 1} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1720766330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f7940c4-b79e-4ece-8dc5-82e4408328d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a3980f17ef4e24903e3835c068ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:21Z,use_quota=True,user_id='b2e82153f1444fe78af69e5ff0b3d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Creating volume 7f7940c4-b79e-4ece-8dc5-82e4408328d2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:12:20 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:12:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:20 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 1073741824 Jun 29 03:12:20 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:21 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866" returned: 0 in 0.966s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:21 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866 Jun 29 03:12:21 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:21 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 1073741824" returned: 0 in 1.089s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:22 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 Jun 29 03:12:22 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:22 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384.47abb3a5-6f82-4b4d-8f3c-3e174f475866" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-47abb3a5-6f82-4b4d-8f3c-3e174f475866" released by "_delete_snapshot" :: held 3.680s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-cdb02cfc-4b88-471e-82d9-e1545088d384" released by "delete_snapshot" :: held 3.702s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Created reservations ['6c7ed210-e2f3-48a1-a941-e1be3f0ad045', '0bf2f460-924b-4652-b35c-72677e343d15', 'da8bf7f3-d312-400d-9844-bd2bb68375f2', '8b7e1195-2e23-40d8-a0c2-8556f3d85e76'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:12:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Delete snapshot completed successfully. Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f3de67d8-aaf8-49f6-a3ff-4749fb5f6b42 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-47abb3a5-6f82-4b4d-8f3c-3e174f475866-delete_snapshot" released by "delete_snapshot" :: held 3.923s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:22 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2" returned: 0 in 0.734s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce564a32-c0ef-4308-a127-e294ae255860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0edaf2-df65-4e57-81fc-d0395a1012cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-cdb02cfc-4b88-471e-82d9-e1545088d384-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Volume volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 (7f7940c4-b79e-4ece-8dc5-82e4408328d2): created successfully Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0edaf2-df65-4e57-81fc-d0395a1012cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Flow 'volume_create_manager' (dc698739-f9eb-4cac-b657-13ebc5f513b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-cdb02cfc-4b88-471e-82d9-e1545088d384-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-60957e62-4261-4808-8e12-c31ec5ebe751 tempest-AttachVolumeTestJSON-1890221435 None] Created volume successfully. Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-quobyte-cdb02cfc-4b88-471e-82d9-e1545088d384" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-cdb02cfc-4b88-471e-82d9-e1545088d384" acquired by "delete_volume" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa2693-f1a4-425a-85a7-ffd418752d6d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:23 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 Jun 29 03:12:23 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:23 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384" returned: 0 in 0.788s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:23 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384 Jun 29 03:12:23 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:24 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cdb02cfc-4b88-471e-82d9-e1545088d384" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-cdb02cfc-4b88-471e-82d9-e1545088d384" released by "delete_volume" :: held 1.583s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Created reservations ['7b531518-fefd-46d2-b7ce-3b68b97a3233', '4d3cd546-f9a8-4288-9429-19ce3cecbaf0', 'd63ac7a2-20ef-490d-b45e-3d81ca3e4b17', 'd8402991-f8ca-4ea8-a85d-c7cbb813e822'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:24 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:12:24 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Lock "cinder-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Acquiring lock "cinder-quobyte-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4272a90-3774-4fc1-8d94-3947c77ddaad]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:25 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf Jun 29 03:12:25 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:25 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.821s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:12:25 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Deleted volume successfully. Jun 29 03:12:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c059ea71-d649-4fab-a95b-46a77cf52049 tempest-CinderUnicodeTest-528281849 None] Lock "cinder-cdb02cfc-4b88-471e-82d9-e1545088d384-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:26 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf" returned: 0 in 0.836s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:26 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf Jun 29 03:12:26 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:26 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf" returned: 0 in 0.684s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Lock "cinder-quobyte-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf" released by "delete_volume" :: held 1.578s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Created reservations ['95d698b5-fe84-4e9d-ba1d-82c2432af002', '958d2a42-c094-4a4a-9f63-42fc9c5f8200', 'b4eb75a7-b713-40fd-9a04-5a88dc324273', '4487d5e0-96e8-4a92-8ff0-655b60db38f1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:26 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:12:26 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[089a06f7-efac-4d14-b263-e06ede804774]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:27 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 Jun 29 03:12:27 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:27 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.825s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:12:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Deleted volume successfully. Jun 29 03:12:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-55f7b9f4-9520-4a6b-a256-6d65fe43661f tempest-CinderUnicodeTest-528281849 None] Lock "cinder-17d3d5ef-03ae-4c3e-b643-4ed04bef98bf-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:12:28 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2" returned: 0 in 0.927s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a54db26b-8be2-4d22-bf4c-1cefd44af45f', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:12:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-b0724717-6d03-431b-90e8-b22898b52579 req-91967d1c-e944-4496-ad96-79113cd57cb5 tempest-AttachVolumeTestJSON-1890221435 None] attachment_update completed successfully. Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Flow 'volume_create_manager' (8f6434e6-c8b2-4924-82e6-1094c95bc875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5514dd83-6f9d-4b95-9c8d-176738e714d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5514dd83-6f9d-4b95-9c8d-176738e714d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1951439969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a3980f17ef4e24903e3835c068ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:34Z,use_quota=True,user_id='b2e82153f1444fe78af69e5ff0b3d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6e276f-b074-49e2-ab46-dbb7701f6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6e276f-b074-49e2-ab46-dbb7701f6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbad8832-1a9b-4b45-8fde-4990cf297694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbad8832-1a9b-4b45-8fde-4990cf297694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6', 'volume_name': 'volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101bd1ba-bf7a-4ee1-bd0b-b7d2ca46ad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101bd1ba-bf7a-4ee1-bd0b-b7d2ca46ad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dfbf06-e7c8-44d6-b0a5-9955ff78587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:34 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Volume e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6', 'volume_size': 1} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1951439969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a3980f17ef4e24903e3835c068ed36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:34Z,use_quota=True,user_id='b2e82153f1444fe78af69e5ff0b3d48e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Creating volume e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:12:34 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:12:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:34 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 1073741824 Jun 29 03:12:34 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:35 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 1073741824" returned: 0 in 1.108s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:35 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 Jun 29 03:12:35 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:36 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" returned: 0 in 0.869s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dfbf06-e7c8-44d6-b0a5-9955ff78587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79ca40b-81db-4713-bfe6-79e58a9d0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:36 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Volume volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 (e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6): created successfully Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a79ca40b-81db-4713-bfe6-79e58a9d0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Flow 'volume_create_manager' (8f6434e6-c8b2-4924-82e6-1094c95bc875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c6579d3a-5f6e-46fa-9288-cafb56d121bc tempest-AttachVolumeTestJSON-1890221435 None] Created volume successfully. Jun 29 03:12:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dd858d-bec5-4fff-93d1-038006f2a925]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:12:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:41 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 Jun 29 03:12:41 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:41 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" returned: 0 in 0.974s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58bed488-c32d-4a75-81d1-ba8dffb69f78', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:12:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-b1daaa3c-4b55-462d-ae56-e6dc04ccf607 req-377a61fb-86d2-4640-86c9-f09160c8d148 tempest-AttachVolumeTestJSON-1890221435 None] attachment_update completed successfully. Jun 29 03:12:49 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=61,cinder:INSERT=13,cinder:UPDATE=63,cinder:DELETE=6 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:12:49 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=63,cinder:UPDATE=77,cinder:INSERT=20,cinder:DELETE=5 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:12:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-cbc78bb8-43a7-43da-9480-d7cd454d3a71 req-ce907711-60e6-411b-8bad-4a8f2b1e3785 tempest-AttachVolumeTestJSON-1890221435 None] Terminate volume connection completed successfully. Jun 29 03:12:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-cbc78bb8-43a7-43da-9480-d7cd454d3a71 req-ce907711-60e6-411b-8bad-4a8f2b1e3785 tempest-AttachVolumeTestJSON-1890221435 None] Deleting attachment a54db26b-8be2-4d22-bf4c-1cefd44af45f. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:12:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-8b37b478-cb89-4b14-8f21-e25b8b19ef41 req-85520699-959f-4220-be1b-5630aa264762 tempest-AttachVolumeTestJSON-1890221435 None] Terminate volume connection completed successfully. Jun 29 03:12:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-8b37b478-cb89-4b14-8f21-e25b8b19ef41 req-85520699-959f-4220-be1b-5630aa264762 tempest-AttachVolumeTestJSON-1890221435 None] Deleting attachment 58bed488-c32d-4a75-81d1-ba8dffb69f78. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Flow 'volume_create_manager' (1450b08a-1898-4796-994d-4ba4cef8a900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4ad151-f568-4e0a-8e9e-76bedbff931e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4ad151-f568-4e0a-8e9e-76bedbff931e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1410341837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b86a2204deda3ff284ef1d682e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:58Z,use_quota=True,user_id='838864b404f043a9883c0f9734141903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442ade77-cb82-4854-9bcf-c7c50d360cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442ade77-cb82-4854-9bcf-c7c50d360cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2399e2-7a1c-47d8-9fc8-c19f257c1e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2399e2-7a1c-47d8-9fc8-c19f257c1e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f', 'volume_name': 'volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847651ac-5b10-41a4-8be7-e8d75dc8f31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (847651ac-5b10-41a4-8be7-e8d75dc8f31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a709f437-e360-4f5c-aad8-97e1036aa4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Volume c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f', 'volume_size': 1} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1410341837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b86a2204deda3ff284ef1d682e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:12:58Z,use_quota=True,user_id='838864b404f043a9883c0f9734141903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Creating volume c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:12:57 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:12:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:57 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f 1073741824 Jun 29 03:12:57 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:58 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f 1073741824" returned: 0 in 1.064s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:12:59 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:12:59 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:12:59 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 0.695s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a709f437-e360-4f5c-aad8-97e1036aa4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e9f79d-b05c-47c2-bbab-a83ac21568e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:12:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Volume volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f (c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f): created successfully Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e9f79d-b05c-47c2-bbab-a83ac21568e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:12:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Flow 'volume_create_manager' (1450b08a-1898-4796-994d-4ba4cef8a900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:12:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6105ae15-b2d0-471a-b4fc-e65192856c00 tempest-SnapshotDependencyTests-185012537 None] Created volume successfully. Jun 29 03:13:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Creating offline snapshot c2c08329-5eb5-4eb1-af13-5d8da771c848 of volume c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:13:01 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c6ec1-6bda-4a08-8830-ac3049de803d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:01 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:13:01 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:02 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 0.819s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:02 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 1G Jun 29 03:13:02 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:03 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 1G" returned: 0 in 0.842s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:03 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 Jun 29 03:13:03 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "cinder-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "cinder-quobyte-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-quobyte-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d302da7d-1afa-449e-b1b4-db5612715e4e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:03 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 Jun 29 03:13:03 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:03 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848" returned: 0 in 0.706s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:03 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 is being set with open permissions: ugo+rw Jun 29 03:13:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:03 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 Jun 29 03:13:03 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:04 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" returned: 0 in 0.861s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:04 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6 Jun 29 03:13:04 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:04 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848" returned: 0 in 0.660s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:04 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info Jun 29 03:13:04 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:04 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" returned: 0 in 0.727s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-quobyte-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6" released by "delete_volume" :: held 1.638s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:04 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Created reservations ['663f924e-f040-4d81-8812-b2e0cc1f2e76', 'c2585fd7-7740-46fb-b044-51cee4193a30', 'f545f282-9235-4f99-9341-4aba13576954', '87841e06-d729-49e0-b83f-590648576447'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:05 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:13:05 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:05 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info" returned: 0 in 0.731s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:05 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info is being set with open permissions: ugo+rw Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:05 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info Jun 29 03:13:05 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "cinder-7f7940c4-b79e-4ece-8dc5-82e4408328d2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-7f7940c4-b79e-4ece-8dc5-82e4408328d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "cinder-quobyte-7f7940c4-b79e-4ece-8dc5-82e4408328d2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-quobyte-7f7940c4-b79e-4ece-8dc5-82e4408328d2" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[77132d3b-2b0a-49a5-b2fd-cc1a9a07bc5e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:05 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.749s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Deleted volume successfully. Jun 29 03:13:05 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 Jun 29 03:13:05 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3d047648-52f4-4883-b600-281dc8cd5e6c tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-e1ec8e90-32a7-4600-9e3d-6cc6b02b9bb6-delete_volume" released by "delete_volume" :: held 2.658s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:06 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.info" returned: 0 in 1.079s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.979s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:06 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3f58d736-70cb-4f9f-82a4-7ad9db0b884d tempest-SnapshotDependencyTests-185012537 None] Create snapshot completed successfully Jun 29 03:13:06 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2" returned: 0 in 1.011s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:06 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2 Jun 29 03:13:06 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Flow 'volume_create_manager' (77c425ab-e0d1-4e77-8f92-3b01709d96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db094ae2-d947-4262-8531-f5b684d6c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db094ae2-d947-4262-8531-f5b684d6c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=087367f8-15cf-49e4-ace7-878fe403e5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aacd5b86a2204deda3ff284ef1d682e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2c08329-5eb5-4eb1-af13-5d8da771c848,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:13:07Z,use_quota=True,user_id='838864b404f043a9883c0f9734141903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abf054b-6ea8-4559-81ef-8c9fc5c49527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abf054b-6ea8-4559-81ef-8c9fc5c49527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189245c2-38d2-4fb6-b388-e41d7f249650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (189245c2-38d2-4fb6-b388-e41d7f249650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '087367f8-15cf-49e4-ace7-878fe403e5bc', 'volume_name': 'volume-087367f8-15cf-49e4-ace7-878fe403e5bc', 'volume_size': 1, 'snapshot_id': 'c2c08329-5eb5-4eb1-af13-5d8da771c848'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee6ad75-d89f-4152-bc3e-4620a079074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee6ad75-d89f-4152-bc3e-4620a079074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a82ee47-350d-4570-ba0d-69069f8028a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:07 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Volume 087367f8-15cf-49e4-ace7-878fe403e5bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-087367f8-15cf-49e4-ace7-878fe403e5bc', 'volume_size': 1, 'snapshot_id': 'c2c08329-5eb5-4eb1-af13-5d8da771c848'} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-quobyte-c2c08329-5eb5-4eb1-af13-5d8da771c848-087367f8-15cf-49e4-ace7-878fe403e5bc" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c2c08329-5eb5-4eb1-af13-5d8da771c848-087367f8-15cf-49e4-ace7-878fe403e5bc" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Creating volume 087367f8-15cf-49e4-ace7-878fe403e5bc from snapshot c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-quobyte-087367f8-15cf-49e4-ace7-878fe403e5bc" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-087367f8-15cf-49e4-ace7-878fe403e5bc" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] snapshot: c2c08329-5eb5-4eb1-af13-5d8da771c848, volume: 087367f8-15cf-49e4-ace7-878fe403e5bc, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:13:07 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7f7940c4-b79e-4ece-8dc5-82e4408328d2" returned: 0 in 1.027s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-quobyte-7f7940c4-b79e-4ece-8dc5-82e4408328d2" released by "delete_volume" :: held 2.100s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[962e08d6-ea43-4ce1-b555-1d6005f69f4a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Created reservations ['ec149d2a-f109-4518-8788-e11fb62eb6c6', '60ed4192-25fc-40ec-b440-8947b590bc6a', '04c26219-def2-4d0d-b5cb-a46289bbe3a1', '22a9300a-3cdc-43db-8408-8e99db032d6a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:07 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 Jun 29 03:13:07 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:07 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:13:07 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:08 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848" returned: 0 in 0.854s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa415bf2-f7e3-4082-8984-d30ddd5e6dad]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:08 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.757s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Deleted volume successfully. Jun 29 03:13:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c9a53ae6-4251-4bf7-bf8e-897ffb1ab889 tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-7f7940c4-b79e-4ece-8dc5-82e4408328d2-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:08 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:13:08 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "cinder-89225fd6-36db-4c36-bae8-b9dc0a0848eb-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-89225fd6-36db-4c36-bae8-b9dc0a0848eb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "cinder-quobyte-89225fd6-36db-4c36-bae8-b9dc0a0848eb" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-quobyte-89225fd6-36db-4c36-bae8-b9dc0a0848eb" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345479c-5753-466c-bbf6-8654387eca6e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:09 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb Jun 29 03:13:09 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:09 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 0.857s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:13:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:09 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc Jun 29 03:13:09 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:10 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb" returned: 0 in 0.834s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:10 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb Jun 29 03:13:10 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:10 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-89225fd6-36db-4c36-bae8-b9dc0a0848eb" returned: 0 in 0.893s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-quobyte-89225fd6-36db-4c36-bae8-b9dc0a0848eb" released by "delete_volume" :: held 1.796s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Created reservations ['d63f739f-444d-4c68-b911-15ac9fe66199', '87241c7d-c991-4ccb-be6e-51272b7b37ce', '59aae9eb-fbb6-4a59-90cc-c6831f3ce4af', '9a98f4c4-aa02-4cec-9372-065cf582ba90'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:11 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:13:11 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:13 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 2.017s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:13 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:13 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Deleted volume successfully. Jun 29 03:13:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eabe4cc4-34c7-42f8-ae21-3facb2d655de tempest-AttachVolumeTestJSON-1890221435 None] Lock "cinder-89225fd6-36db-4c36-bae8-b9dc0a0848eb-delete_volume" released by "delete_volume" :: held 4.270s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:16 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc" returned: 0 in 6.528s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa78bc-7b8f-4d23-b21e-20b8fe1757bb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:16 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:13:16 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:17 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 1.286s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:13:17 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Converted 1024.00 MB image at 156.83 MB/s Jun 29 03:13:17 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc is being set with open permissions: ugo+rw Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:17 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc Jun 29 03:13:17 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:17 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:13:17 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:18 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc" returned: 0 in 1.415s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-087367f8-15cf-49e4-ace7-878fe403e5bc" released by "_copy_volume_from_snapshot" :: held 11.101s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c2c08329-5eb5-4eb1-af13-5d8da771c848-087367f8-15cf-49e4-ace7-878fe403e5bc" released by "_create_volume_from_snapshot" :: held 11.152s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.170s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a82ee47-350d-4570-ba0d-69069f8028a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-087367f8-15cf-49e4-ace7-878fe403e5bc', 'volume_size': 1, 'snapshot_id': 'c2c08329-5eb5-4eb1-af13-5d8da771c848'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b769934-aff2-4e05-b9de-9e3f5fbf8143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:18 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.345s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:13:18 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Volume volume-087367f8-15cf-49e4-ace7-878fe403e5bc (087367f8-15cf-49e4-ace7-878fe403e5bc): created successfully Jun 29 03:13:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b769934-aff2-4e05-b9de-9e3f5fbf8143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Flow 'volume_create_manager' (77c425ab-e0d1-4e77-8f92-3b01709d96cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:13:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ce00f2ff-497f-4b04-a82f-f080b1b7491c tempest-SnapshotDependencyTests-185012537 None] Created volume successfully. Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Flow 'volume_create_manager' (d2a6b864-2150-462e-a2e5-f301e26b25bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3d86e7-8cfa-43b2-a33a-5afe585f3778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3d86e7-8cfa-43b2-a33a-5afe585f3778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1263271122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12713c5-236f-4971-81a6-f2a505447564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e4b73dd47a4f73b06ff4fbdfacab17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:13:20Z,use_quota=True,user_id='14335dd5bcc745abb4105e47c028ed33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf051fc2-ee26-40f1-b810-191bdcc7551e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf051fc2-ee26-40f1-b810-191bdcc7551e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55461f2-31b7-435d-9e9b-eed2625d6cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55461f2-31b7-435d-9e9b-eed2625d6cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c12713c5-236f-4971-81a6-f2a505447564', 'volume_name': 'volume-c12713c5-236f-4971-81a6-f2a505447564', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152a9ea4-5685-471c-bbef-2bfe1cbf3600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152a9ea4-5685-471c-bbef-2bfe1cbf3600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f95ad81-0624-4d24-a363-802416cee0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Volume c12713c5-236f-4971-81a6-f2a505447564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c12713c5-236f-4971-81a6-f2a505447564', 'volume_size': 1} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1263271122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c12713c5-236f-4971-81a6-f2a505447564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e4b73dd47a4f73b06ff4fbdfacab17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:13:20Z,use_quota=True,user_id='14335dd5bcc745abb4105e47c028ed33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Creating volume c12713c5-236f-4971-81a6-f2a505447564 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:13:19 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:13:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:19 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 1073741824 Jun 29 03:13:19 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-c2c08329-5eb5-4eb1-af13-5d8da771c848-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-c2c08329-5eb5-4eb1-af13-5d8da771c848-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-quobyte-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-quobyte-c2c08329-5eb5-4eb1-af13-5d8da771c848" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c2c08329-5eb5-4eb1-af13-5d8da771c848" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Deleting offline snapshot c2c08329-5eb5-4eb1-af13-5d8da771c848 of volume c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] snapshot_file for this snap is: volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb84f1-1eb1-47d3-a229-6a68a56217c7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:20 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 Jun 29 03:13:20 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:20 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 1073741824" returned: 0 in 1.094s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:20 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 Jun 29 03:13:20 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:21 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848" returned: 0 in 1.019s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f19cec-cc58-4cc5-8d3d-31a53f00a3d6]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:21 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:13:21 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:21 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564" returned: 0 in 0.830s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f95ad81-0624-4d24-a363-802416cee0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c12713c5-236f-4971-81a6-f2a505447564', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005c7de0-0bcd-4d7d-a680-ed1c422038e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:21 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Volume volume-c12713c5-236f-4971-81a6-f2a505447564 (c12713c5-236f-4971-81a6-f2a505447564): created successfully Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005c7de0-0bcd-4d7d-a680-ed1c422038e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Flow 'volume_create_manager' (d2a6b864-2150-462e-a2e5-f301e26b25bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:13:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4b2aea07-7fb7-491d-8c94-b3be2825b32d tempest-TestMinimumBasicScenario-1776599327 None] Created volume successfully. Jun 29 03:13:22 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 0.957s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:22 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 Jun 29 03:13:22 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:23 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848" returned: 0 in 0.835s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:23 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848 Jun 29 03:13:23 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:23 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f.c2c08329-5eb5-4eb1-af13-5d8da771c848" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c2c08329-5eb5-4eb1-af13-5d8da771c848" released by "_delete_snapshot" :: held 3.728s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" released by "delete_snapshot" :: held 3.766s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Created reservations ['4305be2e-0055-420a-8806-f1ffc94866c5', '47100f36-4d48-4582-bf5d-d05671145dee', '763681c5-9409-4c8c-b71c-0171d9eeacf7', 'ed52ede1-b16a-46b0-a3ba-b3bb8151e86f'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:24 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Delete snapshot completed successfully. Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-317234da-15d1-4cf3-b433-26c4c79a2822 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-c2c08329-5eb5-4eb1-af13-5d8da771c848-delete_snapshot" released by "delete_snapshot" :: held 3.925s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b2f52928-82e9-4e25-b7aa-e215fbe98141 tempest-BackendsCapabilitiesAdminTestsJSON-500824235 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93518) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-quobyte-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac886d-4dd1-49c9-a62d-8c8762dca77a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:24 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:13:24 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2dfa682c-3c4c-45b3-a0f9-27956fcc9eaa tempest-BackendsCapabilitiesAdminTestsJSON-500824235 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93518) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 29 03:13:25 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 0.810s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:25 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f Jun 29 03:13:25 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:26 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" returned: 0 in 0.780s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f" released by "delete_volume" :: held 1.659s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Created reservations ['28851505-4dd1-4bce-a864-a63ccdc21d69', 'a87d3b3c-abde-4cb7-9a96-d09266f9d263', '9138562f-4ad8-442b-96a0-86fa6a66b388', '94b0974c-a326-4ace-a47e-8f12af143d33'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165f413-1bf0-4a2f-b87a-ebc18b660d1e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:26 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:13:26 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:26 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 Jun 29 03:13:26 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-087367f8-15cf-49e4-ace7-878fe403e5bc-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-087367f8-15cf-49e4-ace7-878fe403e5bc-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "cinder-quobyte-087367f8-15cf-49e4-ace7-878fe403e5bc" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-087367f8-15cf-49e4-ace7-878fe403e5bc" acquired by "delete_volume" :: waited 0.057s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63e228-ab60-444c-9bd7-b702b31c5b27]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:27 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc Jun 29 03:13:27 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:27 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.139s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Deleted volume successfully. Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5060d2c1-0893-4a85-bfba-960c96342129 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-c4db5b35-7fb5-4130-ad35-3ccbe7f1cb3f-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:27 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564" returned: 0 in 1.266s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.287s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-c12713c5-236f-4971-81a6-f2a505447564', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '004b594d-28d9-4b15-8306-cf83000ce3b5', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:13:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-679d49a4-6ba0-49e8-b8fb-0c44e0fb8b42 req-4c71d130-ba8c-4528-8356-146790f40bc2 tempest-TestMinimumBasicScenario-1776599327 None] attachment_update completed successfully. Jun 29 03:13:28 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc" returned: 0 in 1.173s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:28 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc Jun 29 03:13:28 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:29 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-087367f8-15cf-49e4-ace7-878fe403e5bc" returned: 0 in 0.918s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-quobyte-087367f8-15cf-49e4-ace7-878fe403e5bc" released by "delete_volume" :: held 2.195s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Created reservations ['73a4d7b2-2ce4-46ce-b920-7bf343cdb8e9', 'a1bac739-1c30-4c9e-93c0-1ad42f482279', 'a7a8dae3-1778-476d-a79d-9baa5caae7e5', 'e31d6189-4aca-4c6d-9a86-7a08aaf6771f'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:29 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:13:29 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:30 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.770s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:30 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:13:30 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Deleted volume successfully. Jun 29 03:13:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5682f3e2-5e27-46e2-8de0-20c968486a72 tempest-SnapshotDependencyTests-185012537 None] Lock "cinder-087367f8-15cf-49e4-ace7-878fe403e5bc-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Flow 'volume_create_manager' (d4b32d9c-3fa0-4afa-bf7b-92ba708fc070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecb72d2-0f8e-440d-b43e-6a2a170e2521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ecb72d2-0f8e-440d-b43e-6a2a170e2521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1554589789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759d9ebd-c2d0-44aa-aec8-1c642b946119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d014233e96f24a6a86ad9e8d9c84d3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:13:39Z,use_quota=True,user_id='bfbdd44cbb914c6f8945c0919f976c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db4dcd6-1422-456d-b3e9-9e17ca64dd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db4dcd6-1422-456d-b3e9-9e17ca64dd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5460467-d98f-4dc0-98d2-b607347b24a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5460467-d98f-4dc0-98d2-b607347b24a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759d9ebd-c2d0-44aa-aec8-1c642b946119', 'volume_name': 'volume-759d9ebd-c2d0-44aa-aec8-1c642b946119', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5d5e07-4a4e-4d19-ab40-32a45d7abf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5d5e07-4a4e-4d19-ab40-32a45d7abf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb61b381-9c32-45c4-b611-ff2b5ae7ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:39 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Volume 759d9ebd-c2d0-44aa-aec8-1c642b946119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759d9ebd-c2d0-44aa-aec8-1c642b946119', 'volume_size': 1} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1554589789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759d9ebd-c2d0-44aa-aec8-1c642b946119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d014233e96f24a6a86ad9e8d9c84d3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:13:39Z,use_quota=True,user_id='bfbdd44cbb914c6f8945c0919f976c86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Creating volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:13:39 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:13:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:39 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 1073741824 Jun 29 03:13:39 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:40 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 1073741824" returned: 0 in 1.243s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:40 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 Jun 29 03:13:40 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:41 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119" returned: 0 in 0.780s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.125s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb61b381-9c32-45c4-b611-ff2b5ae7ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759d9ebd-c2d0-44aa-aec8-1c642b946119', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8797206a-afef-4006-a6b9-8a2eb47d0853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:13:41 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Volume volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 (759d9ebd-c2d0-44aa-aec8-1c642b946119): created successfully Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8797206a-afef-4006-a6b9-8a2eb47d0853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:13:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Flow 'volume_create_manager' (d4b32d9c-3fa0-4afa-bf7b-92ba708fc070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:13:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-05836d66-e73d-4b4c-90ff-b6bbc7eb4d9f tempest-SnapshotsActionsTest-1817422141 None] Created volume successfully. Jun 29 03:13:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Creating offline snapshot e31bec89-3df5-4687-a55a-70c8aa2899e9 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:13:42 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab6989e-0cb0-41d4-80a7-feb498b84e37]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:42 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 Jun 29 03:13:42 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:43 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:43 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 1G Jun 29 03:13:43 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:44 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 1G" returned: 0 in 0.822s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:44 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:13:44 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:44 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.681s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:44 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 is being set with open permissions: ugo+rw Jun 29 03:13:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:44 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:13:44 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:45 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.630s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:45 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info Jun 29 03:13:45 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:46 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info" returned: 0 in 0.633s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:46 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info is being set with open permissions: ugo+rw Jun 29 03:13:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:46 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info Jun 29 03:13:46 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:46 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.info" returned: 0 in 0.649s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.306s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-64e2be2e-1868-4143-ab98-ce894ddf8f91 tempest-SnapshotsActionsTest-1817422141 None] Create snapshot completed successfully Jun 29 03:13:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Creating offline snapshot 1ff76223-b2f7-4585-912a-42ea9075a5e8 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:13:48 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2306f7-1d96-4a31-8aa0-8873286e9413]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:48 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:13:48 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:49 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.752s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:13:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:49 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 1G Jun 29 03:13:49 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:49 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 1G" returned: 0 in 0.775s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:49 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 Jun 29 03:13:49 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:50 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8" returned: 0 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:50 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 is being set with open permissions: ugo+rw Jun 29 03:13:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:50 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 Jun 29 03:13:50 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:51 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8" returned: 0 in 0.618s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=46,cinder:UPDATE=71,cinder:INSERT=15,cinder:DELETE=5 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=64,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=6 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.953s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:51 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e7dcfb5e-d1e5-40f4-bf06-10873b2e23bb tempest-SnapshotsActionsTest-1817422141 None] Create snapshot completed successfully Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-1ff76223-b2f7-4585-912a-42ea9075a5e8-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-1ff76223-b2f7-4585-912a-42ea9075a5e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-1ff76223-b2f7-4585-912a-42ea9075a5e8" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-1ff76223-b2f7-4585-912a-42ea9075a5e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Deleting offline snapshot 1ff76223-b2f7-4585-912a-42ea9075a5e8 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] snapshot_file for this snap is: volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[74362392-eb35-4407-bceb-c09ceb1e7d48]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:51 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 Jun 29 03:13:51 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:52 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8" returned: 0 in 0.745s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:13:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb72a5fd-0a16-485d-9df2-79c97ea5e640]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:52 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:13:52 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:53 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.913s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:13:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:53 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 Jun 29 03:13:53 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:54 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8" returned: 0 in 0.802s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:54 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8 Jun 29 03:13:54 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:54 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.1ff76223-b2f7-4585-912a-42ea9075a5e8" returned: 0 in 0.775s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-1ff76223-b2f7-4585-912a-42ea9075a5e8" released by "_delete_snapshot" :: held 3.353s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" released by "delete_snapshot" :: held 3.377s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:54 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Created reservations ['cd498301-ee20-4f27-993d-025ad20813aa', 'c470168b-d492-4144-a665-3e17cb032035', '46ce7960-ab2f-4b81-889e-15ac5887953c', 'ea47004d-c3ba-4614-9cf6-c0e9065cbc8e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:13:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Delete snapshot completed successfully. Jun 29 03:13:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-9d8fcd9d-86dc-4751-8eaf-987f1248de3b tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-1ff76223-b2f7-4585-912a-42ea9075a5e8-delete_snapshot" released by "delete_snapshot" :: held 3.606s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Creating offline snapshot a403bbcb-d465-4d99-8d01-143872e60956 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43c06e0-b47f-43b4-a19d-bfebd0dd722f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:56 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:13:56 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:56 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:13:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:56 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 1G Jun 29 03:13:56 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:57 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 1G" returned: 0 in 0.813s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:57 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 Jun 29 03:13:57 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:58 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956" returned: 0 in 0.674s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:58 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 is being set with open permissions: ugo+rw Jun 29 03:13:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:13:58 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 Jun 29 03:13:58 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:13:59 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jun 29 03:13:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956" returned: 0 in 0.658s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:13:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:13:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-43cd8c36-f662-4fdf-9432-00ef2052034e tempest-SnapshotsActionsTest-1817422141 None] Create snapshot completed successfully Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-a403bbcb-d465-4d99-8d01-143872e60956-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-a403bbcb-d465-4d99-8d01-143872e60956-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-a403bbcb-d465-4d99-8d01-143872e60956" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-a403bbcb-d465-4d99-8d01-143872e60956" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Deleting offline snapshot a403bbcb-d465-4d99-8d01-143872e60956 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] snapshot_file for this snap is: volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa78ab-1ddf-4ca7-9f77-a12e657b00f0]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:00 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 Jun 29 03:14:00 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:01 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956" returned: 0 in 0.744s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4b1c3c-2ae0-4fb8-86de-c95ebb102b64]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:01 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:01 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:01 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:01 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 Jun 29 03:14:01 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:02 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956" returned: 0 in 0.741s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:02 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956 Jun 29 03:14:02 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:03 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.a403bbcb-d465-4d99-8d01-143872e60956" returned: 0 in 0.627s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-a403bbcb-d465-4d99-8d01-143872e60956" released by "_delete_snapshot" :: held 2.977s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" released by "delete_snapshot" :: held 3.000s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:03 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Created reservations ['07dfd7a0-8729-40f0-8b7e-51898f7e04a4', 'e001a60f-be0e-483c-925f-a4beae93cc3c', '73d12bd8-2095-4d27-aca2-8ab862a8a6b1', '3b35bed4-d7e0-400a-b554-b61030cef089'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Delete snapshot completed successfully. Jun 29 03:14:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-06c5fb74-33c6-4885-bd51-e3468d8960f0 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-a403bbcb-d465-4d99-8d01-143872e60956-delete_snapshot" released by "delete_snapshot" :: held 3.148s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Creating offline snapshot 05ad2665-c207-4cc5-a77a-d8ebad6fe54e of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:14:04 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c153ee10-c668-446c-9416-04f306e6636d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:04 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:04 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:05 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.737s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:05 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e 1G Jun 29 03:14:05 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:06 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e 1G" returned: 0 in 0.822s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:06 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e Jun 29 03:14:06 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:07 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e" returned: 0 in 0.723s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:07 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e is being set with open permissions: ugo+rw Jun 29 03:14:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:07 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e Jun 29 03:14:07 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:07 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e" returned: 0 in 0.730s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.111s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c0eefcf7-c158-4e6d-9911-04fa2e9a2dd2 tempest-SnapshotsActionsTest-1817422141 None] Create snapshot completed successfully Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-05ad2665-c207-4cc5-a77a-d8ebad6fe54e-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-05ad2665-c207-4cc5-a77a-d8ebad6fe54e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-05ad2665-c207-4cc5-a77a-d8ebad6fe54e" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-05ad2665-c207-4cc5-a77a-d8ebad6fe54e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Deleting offline snapshot 05ad2665-c207-4cc5-a77a-d8ebad6fe54e of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] snapshot_file for this snap is: volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec13427-d8fc-4923-950c-2364a9d67552]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:09 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e Jun 29 03:14:09 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:09 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e" returned: 0 in 0.792s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a27294b-d894-42b0-a0b0-08a3de8c64f5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:10 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:10 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:10 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.765s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:10 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e Jun 29 03:14:10 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:11 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e" returned: 0 in 0.778s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:11 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e Jun 29 03:14:11 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:12 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.05ad2665-c207-4cc5-a77a-d8ebad6fe54e" returned: 0 in 0.630s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-05ad2665-c207-4cc5-a77a-d8ebad6fe54e" released by "_delete_snapshot" :: held 3.063s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" released by "delete_snapshot" :: held 3.088s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:12 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Created reservations ['c84e7c25-0471-4fe6-b7c5-f82681f3b32a', '169ee465-05f8-4b77-8ffb-0d81d7c4d1c1', '0eba8367-8c56-4b81-a0fe-7ea576d537a6', 'e4477858-0784-4815-8783-d8c2b7e5086d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Delete snapshot completed successfully. Jun 29 03:14:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-664ca27d-1ee9-419a-89fd-c3f0a16a6934 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-05ad2665-c207-4cc5-a77a-d8ebad6fe54e-delete_snapshot" released by "delete_snapshot" :: held 3.215s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Creating offline snapshot b95c6de8-c5d0-4094-868b-5f8dea8465b4 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:14:13 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f2dfea-2288-4b85-97f0-d4a3cd6f0807]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:13 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:13 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:14 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.804s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:14 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 1G Jun 29 03:14:14 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:15 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 1G" returned: 0 in 0.824s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:15 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 Jun 29 03:14:15 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:15 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4" returned: 0 in 0.741s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:16 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 is being set with open permissions: ugo+rw Jun 29 03:14:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:16 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 Jun 29 03:14:16 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:16 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4" returned: 0 in 0.659s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d15153e6-1b54-4f4a-851a-b405a7a6f23b tempest-SnapshotsActionsTest-1817422141 None] Create snapshot completed successfully Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:17 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:14:17 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-b95c6de8-c5d0-4094-868b-5f8dea8465b4-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-b95c6de8-c5d0-4094-868b-5f8dea8465b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Acquiring lock "cinder-quobyte-b95c6de8-c5d0-4094-868b-5f8dea8465b4" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-b95c6de8-c5d0-4094-868b-5f8dea8465b4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Deleting offline snapshot b95c6de8-c5d0-4094-868b-5f8dea8465b4 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:14:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] snapshot_file for this snap is: volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c511e7-fda3-48ec-81f3-1620e2031355]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:18 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 Jun 29 03:14:18 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:18 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.828s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:14:18 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4" returned: 0 in 0.901s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd0af4-1a39-439e-aa5b-7089961c63ef]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:19 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:19 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:19 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.771s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:19 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 Jun 29 03:14:19 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-abf70350-7655-4934-9f28-1afc315199d2 req-6afc3e2a-ea8e-420f-bc31-f4a0b57ee8d9 tempest-TestMinimumBasicScenario-1776599327 None] Terminate volume connection completed successfully. Jun 29 03:14:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-abf70350-7655-4934-9f28-1afc315199d2 req-6afc3e2a-ea8e-420f-bc31-f4a0b57ee8d9 tempest-TestMinimumBasicScenario-1776599327 None] Deleting attachment 004b594d-28d9-4b15-8306-cf83000ce3b5. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:14:20 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4" returned: 0 in 0.864s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:20 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4 Jun 29 03:14:20 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:21 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.b95c6de8-c5d0-4094-868b-5f8dea8465b4" returned: 0 in 0.661s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-b95c6de8-c5d0-4094-868b-5f8dea8465b4" released by "_delete_snapshot" :: held 3.320s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" released by "delete_snapshot" :: held 3.346s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:21 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Created reservations ['193b8497-37bf-4b65-a418-4c66caae74cd', '70e6ab19-6c84-4e49-8556-1d438e62e9ba', '7dc75b3d-91bb-4d15-bc5f-50f62d40366b', 'ee19bff9-8d3a-41f3-bbfa-767879ed9848'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Delete snapshot completed successfully. Jun 29 03:14:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-51ded865-9f9e-4fe0-9a5c-739e25e6aa65 tempest-SnapshotsActionsTest-1569348677 None] Lock "cinder-b95c6de8-c5d0-4094-868b-5f8dea8465b4-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Acquiring lock "cinder-c12713c5-236f-4971-81a6-f2a505447564-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Lock "cinder-c12713c5-236f-4971-81a6-f2a505447564-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Acquiring lock "cinder-quobyte-c12713c5-236f-4971-81a6-f2a505447564" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Lock "cinder-quobyte-c12713c5-236f-4971-81a6-f2a505447564" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c964d1cd-9798-4230-9be1-0629fec824be]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:22 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 Jun 29 03:14:22 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "cinder-e31bec89-3df5-4687-a55a-70c8aa2899e9-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-e31bec89-3df5-4687-a55a-70c8aa2899e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "cinder-quobyte-e31bec89-3df5-4687-a55a-70c8aa2899e9" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-quobyte-e31bec89-3df5-4687-a55a-70c8aa2899e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Deleting offline snapshot e31bec89-3df5-4687-a55a-70c8aa2899e9 of volume 759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] snapshot_file for this snap is: volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc09f42-d656-45cb-97f1-92775a2a6bd2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:22 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:22 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:23 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564" returned: 0 in 0.850s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:23 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564 Jun 29 03:14:23 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:23 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-759d9ebd-c2d0-44aa-aec8-1c642b946119(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f97080-75da-4b90-a030-82903648e7c5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:23 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 Jun 29 03:14:23 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:23 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c12713c5-236f-4971-81a6-f2a505447564" returned: 0 in 0.736s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Lock "cinder-quobyte-c12713c5-236f-4971-81a6-f2a505447564" released by "delete_volume" :: held 1.635s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Created reservations ['ec817eb2-56f3-44f6-88dd-491407e687a9', 'c0f5bdbb-cf0e-4513-8d0a-059c99137d4d', 'aede968a-35e2-4545-a4f8-aadba36aafa8', '00edbff3-214e-480b-acf7-c53e9dec17ee'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:23 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:14:23 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:24 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119" returned: 0 in 0.773s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:24 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:24 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:24 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.714s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:24 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:14:24 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Deleted volume successfully. Jun 29 03:14:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-c5035720-5bbe-46d0-aaf7-16c2c32f8c0b tempest-TestMinimumBasicScenario-1776599327 None] Lock "cinder-c12713c5-236f-4971-81a6-f2a505447564-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:25 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.843s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:25 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9 Jun 29 03:14:25 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:26 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119.e31bec89-3df5-4687-a55a-70c8aa2899e9" returned: 0 in 0.885s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-quobyte-e31bec89-3df5-4687-a55a-70c8aa2899e9" released by "_delete_snapshot" :: held 3.458s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" released by "delete_snapshot" :: held 3.481s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Created reservations ['ee87f103-4837-48f3-8b68-7c2a46c8f536', '3f9c38f9-714a-494e-9024-29ec7c1e4edd', '954d2303-259c-4dd4-9592-0197d63a1ef2', 'af6d2749-6de7-4334-823c-bdf045cfbfe9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Delete snapshot completed successfully. Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-49a8dbe6-61b7-4e7d-974f-b10d426b36b7 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-e31bec89-3df5-4687-a55a-70c8aa2899e9-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "cinder-759d9ebd-c2d0-44aa-aec8-1c642b946119-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-759d9ebd-c2d0-44aa-aec8-1c642b946119-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36e8381-ac31-4cee-8cf9-4352bd117cc5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:27 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 Jun 29 03:14:27 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:27 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119" returned: 0 in 0.833s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:27 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119 Jun 29 03:14:27 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:28 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-759d9ebd-c2d0-44aa-aec8-1c642b946119" returned: 0 in 0.647s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-quobyte-759d9ebd-c2d0-44aa-aec8-1c642b946119" released by "delete_volume" :: held 1.547s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Created reservations ['a378c922-a93d-4fd8-af3c-bb4099f15e94', 'e472fd4f-9e85-401f-ae16-f8d63663e516', 'ac5a0faf-8552-41b7-a047-983b094d6674', '90a10894-e7cb-43f3-a171-58cfa8448db7'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:28 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:14:28 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:29 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.704s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:29 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:14:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Deleted volume successfully. Jun 29 03:14:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-54cd65a3-8d95-4293-8232-85c0d34414e1 tempest-SnapshotsActionsTest-1817422141 None] Lock "cinder-759d9ebd-c2d0-44aa-aec8-1c642b946119-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:38 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=45,cinder:INSERT=14,cinder:UPDATE=43,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:14:39 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=40,cinder:UPDATE=51,cinder:DELETE=5,cinder:INSERT=14 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:14:40 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Flow 'volume_create_manager' (e235267b-1e0e-4e4b-9782-3e67f56851bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8855b-74f9-4dcc-9b43-8f0e2714a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0af8855b-74f9-4dcc-9b43-8f0e2714a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-436055990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee8e33a-0f8e-4b78-b8b3-533f63642d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6eb0f1fd8048e6b4466c2ff86ea70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:14:41Z,use_quota=True,user_id='d1bf03f757464cb0b36ee34405771ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6afde760-f60a-4fef-a47d-fc19e1e5bcda),volume_type_id=6afde760-f60a-4fef-a47d-fc19e1e5bcda)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a508520-5d53-47d7-bd2d-f0e3ca057864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a508520-5d53-47d7-bd2d-f0e3ca057864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c04a90-5ac0-4239-b200-701f6f383184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c04a90-5ac0-4239-b200-701f6f383184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee8e33a-0f8e-4b78-b8b3-533f63642d29', 'volume_name': 'volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17dcba2-fff6-4db9-a222-d23926913b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17dcba2-fff6-4db9-a222-d23926913b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7921a2e7-901a-4cf7-ad08-e2c9b71f7b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:14:41 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Volume aee8e33a-0f8e-4b78-b8b3-533f63642d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29', 'volume_size': 1} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-436055990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee8e33a-0f8e-4b78-b8b3-533f63642d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb6eb0f1fd8048e6b4466c2ff86ea70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:14:41Z,use_quota=True,user_id='d1bf03f757464cb0b36ee34405771ea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6afde760-f60a-4fef-a47d-fc19e1e5bcda),volume_type_id=6afde760-f60a-4fef-a47d-fc19e1e5bcda)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Creating volume aee8e33a-0f8e-4b78-b8b3-533f63642d29 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:14:41 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:41 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 1073741824 Jun 29 03:14:41 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:41 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 1073741824" returned: 0 in 0.853s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:41 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 Jun 29 03:14:41 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:42 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29" returned: 0 in 0.728s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7921a2e7-901a-4cf7-ad08-e2c9b71f7b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f59fa88-122e-466f-b5da-64d8a720c50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:14:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Volume volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 (aee8e33a-0f8e-4b78-b8b3-533f63642d29): created successfully Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f59fa88-122e-466f-b5da-64d8a720c50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:14:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Flow 'volume_create_manager' (e235267b-1e0e-4e4b-9782-3e67f56851bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:14:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8471e53a-a7a4-4a62-a354-300a1dd4ba73 tempest-VolumeTypesAccessTest-1284416250 None] Created volume successfully. Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Acquiring lock "cinder-aee8e33a-0f8e-4b78-b8b3-533f63642d29-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Lock "cinder-aee8e33a-0f8e-4b78-b8b3-533f63642d29-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Acquiring lock "cinder-quobyte-aee8e33a-0f8e-4b78-b8b3-533f63642d29" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Lock "cinder-quobyte-aee8e33a-0f8e-4b78-b8b3-533f63642d29" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f77a34-5b95-414b-9259-3e3e10e19b8b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:43 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 Jun 29 03:14:43 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:43 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29" returned: 0 in 0.770s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:43 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29 Jun 29 03:14:43 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:44 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-aee8e33a-0f8e-4b78-b8b3-533f63642d29" returned: 0 in 0.684s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Lock "cinder-quobyte-aee8e33a-0f8e-4b78-b8b3-533f63642d29" released by "delete_volume" :: held 1.495s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:44 devstack cinder-volume[93518]: WARNING cinder.quota [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1671581321 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1671581321, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:14:44 devstack cinder-volume[93518]: WARNING cinder.quota [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1671581321 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1671581321, it is now deprecated. Please use the default quota class for default quota. Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Created reservations ['026d4ebe-4ed8-49d7-9cc4-043644e35093', 'b0e03425-9447-4fe3-89f8-1bd1995f8a61', 'c0f5e1a1-ecd8-4908-b946-69d78bd05cc4', '8483a84d-273c-4aa4-88cf-00dd79f950d6'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:14:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:14:44 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:14:44 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:14:45 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jun 29 03:14:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.653s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:14:45 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:14:45 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Deleted volume successfully. Jun 29 03:14:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d87322e4-858d-4e59-a0c4-ea790374203c tempest-VolumeTypesAccessTest-1284416250 None] Lock "cinder-aee8e33a-0f8e-4b78-b8b3-533f63642d29-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:14:54 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=8,cinder:UPDATE=15,cinder:INSERT=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:14:55 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:15:12 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:17 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:15:17 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:18 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.700s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:15:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:15:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:15:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (305d93ca-4af5-46e4-9302-0f2f96f96422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8834fa2d-f821-4e84-b806-4f9652eb6728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8834fa2d-f821-4e84-b806-4f9652eb6728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747232532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e971dd-269d-4234-a860-d6dbbd3c2f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:28Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cf70aa-c8ce-4077-9e36-6e122386de0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cf70aa-c8ce-4077-9e36-6e122386de0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7493f8c0-71dc-4ca8-8d7d-4e6f011548c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7493f8c0-71dc-4ca8-8d7d-4e6f011548c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e971dd-269d-4234-a860-d6dbbd3c2f1b', 'volume_name': 'volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a38cc0d-df47-4f2a-9086-fd2d1b0bb85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a38cc0d-df47-4f2a-9086-fd2d1b0bb85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106649c8-69d1-4caa-a7a0-ab8e80ca26ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:27 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Volume 20e971dd-269d-4234-a860-d6dbbd3c2f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b', 'volume_size': 1} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1747232532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e971dd-269d-4234-a860-d6dbbd3c2f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:28Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Creating volume 20e971dd-269d-4234-a860-d6dbbd3c2f1b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:15:27 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:15:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:27 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b 1073741824 Jun 29 03:15:27 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:29 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b 1073741824" returned: 0 in 1.252s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:29 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b Jun 29 03:15:29 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:30 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b" returned: 0 in 0.903s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (106649c8-69d1-4caa-a7a0-ab8e80ca26ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616df7a0-cf9f-4de6-8d83-cebc6f68be21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:30 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Volume volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b (20e971dd-269d-4234-a860-d6dbbd3c2f1b): created successfully Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616df7a0-cf9f-4de6-8d83-cebc6f68be21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (305d93ca-4af5-46e4-9302-0f2f96f96422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:30 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f357dcc7-789c-4388-917d-0ece71815e13 tempest-VolumesActionsTest-1362134747 None] Created volume successfully. Jun 29 03:15:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-50715828-ac46-4fb8-bf24-99491a3af4a9 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b" by "attach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-50715828-ac46-4fb8-bf24-99491a3af4a9 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b" acquired by "attach_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-50715828-ac46-4fb8-bf24-99491a3af4a9 tempest-VolumesActionsTest-1362134747 None] Attaching volume 20e971dd-269d-4234-a860-d6dbbd3c2f1b to instance 3a7c1261-32ab-489a-9f9e-dad9a123e07e at mountpoint /dev/vdb on host None. Jun 29 03:15:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-50715828-ac46-4fb8-bf24-99491a3af4a9 tempest-VolumesActionsTest-1362134747 None] Attach volume completed successfully. Jun 29 03:15:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-50715828-ac46-4fb8-bf24-99491a3af4a9 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b" released by "attach_volume" :: held 0.115s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1d563176-3a3b-48ed-96a1-274e160f57c2 tempest-VolumesActionsTest-271990538 None] Terminate volume connection completed successfully. Jun 29 03:15:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d563176-3a3b-48ed-96a1-274e160f57c2 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-detach_volume" by "detach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d563176-3a3b-48ed-96a1-274e160f57c2 tempest-VolumesActionsTest-271990538 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1d563176-3a3b-48ed-96a1-274e160f57c2 tempest-VolumesActionsTest-271990538 None] Detaching volume 20e971dd-269d-4234-a860-d6dbbd3c2f1b from instance 3a7c1261-32ab-489a-9f9e-dad9a123e07e. Jun 29 03:15:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1d563176-3a3b-48ed-96a1-274e160f57c2 tempest-VolumesActionsTest-271990538 None] Detach volume completed successfully. Jun 29 03:15:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1d563176-3a3b-48ed-96a1-274e160f57c2 tempest-VolumesActionsTest-271990538 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-detach_volume" released by "detach_volume" :: held 0.072s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cf97c6b8-e73d-4189-b629-e0c0c1a77d06 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-detach_volume" by "detach_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cf97c6b8-e73d-4189-b629-e0c0c1a77d06 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cf97c6b8-e73d-4189-b629-e0c0c1a77d06 tempest-VolumesActionsTest-1362134747 None] Volume detach called, but volume not attached. Jun 29 03:15:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cf97c6b8-e73d-4189-b629-e0c0c1a77d06 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Acquiring lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Acquiring lock "cinder-quobyte-20e971dd-269d-4234-a860-d6dbbd3c2f1b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Lock "cinder-quobyte-20e971dd-269d-4234-a860-d6dbbd3c2f1b" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[506ca68d-6722-4d75-a7bc-955bf54495e6]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:34 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b Jun 29 03:15:34 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:34 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b" returned: 0 in 0.802s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:34 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b Jun 29 03:15:34 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:35 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-20e971dd-269d-4234-a860-d6dbbd3c2f1b" returned: 0 in 0.721s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Lock "cinder-quobyte-20e971dd-269d-4234-a860-d6dbbd3c2f1b" released by "delete_volume" :: held 1.571s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Created reservations ['22513dc8-c4be-433b-bbf2-2d475f484a92', 'e007fb18-a869-4ecf-bd21-ec88b9b11bcd', '13d40ac6-5b39-4322-9053-32d1558bf297', '0104d5e9-1653-407b-9a3e-873e8a5e42b6'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:35 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:15:35 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:36 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:36 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:15:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Deleted volume successfully. Jun 29 03:15:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-136d30bd-69cc-4178-9873-c49d1c16bd6c tempest-VolumesActionsTest-1362134747 None] Lock "cinder-20e971dd-269d-4234-a860-d6dbbd3c2f1b-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (0c139db5-602d-4fd3-8df8-df7d95bfcd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b0d157-c36a-4a8a-8e52-19ea1353b76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b0d157-c36a-4a8a-8e52-19ea1353b76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389271981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:43Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6128609f-7479-4642-a79c-df6db569cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6128609f-7479-4642-a79c-df6db569cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b85e9d4-1f38-4ac7-a5d6-352cb7b0d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b85e9d4-1f38-4ac7-a5d6-352cb7b0d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8', 'volume_name': 'volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6d8e2b-af12-45c5-889e-63b12f0cd860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6d8e2b-af12-45c5-889e-63b12f0cd860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57ed96c-bedc-4555-b0a5-01e75c444a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:43 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Volume 2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8', 'volume_size': 1} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389271981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:43Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Creating volume 2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:15:43 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:15:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:43 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 1073741824 Jun 29 03:15:43 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:44 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 1073741824" returned: 0 in 0.770s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:44 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 Jun 29 03:15:44 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:44 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8" returned: 0 in 0.618s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b57ed96c-bedc-4555-b0a5-01e75c444a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249cc37e-76ef-4c88-8383-58230a30d302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:44 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Volume volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 (2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8): created successfully Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249cc37e-76ef-4c88-8383-58230a30d302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (0c139db5-602d-4fd3-8df8-df7d95bfcd69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:44 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-efa13b15-cf10-4716-906b-3788c118de22 tempest-VolumesActionsTest-1362134747 None] Created volume successfully. Jun 29 03:15:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Lock "cinder-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-quobyte-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8" acquired by "delete_volume" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:45 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f64e3dd-2ee9-453a-b44b-9615b8edcbd9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:15:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:45 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 Jun 29 03:15:45 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:46 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8" returned: 0 in 0.838s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:46 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8 Jun 29 03:15:46 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:47 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8" returned: 0 in 0.682s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8" released by "delete_volume" :: held 1.566s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Created reservations ['9c3d1d00-298f-4d91-b37f-86746c4f2703', 'a38a0cb7-49a7-47f7-8470-fbe032ba0cbc', '55b1bc12-a867-41e7-b5d5-41ec3731ef83', '73903be5-c30f-4c5a-bf29-c8859ff3c723'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:47 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:15:47 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:47 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.631s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:15:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Deleted volume successfully. Jun 29 03:15:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-48550538-e5d6-4c92-b839-461f8d57865e tempest-VolumesActionsTest-271990538 None] Lock "cinder-2c6e9ac2-dbde-4aba-b13b-d26b1384f2b8-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (62dcc63f-e0a3-4332-a28a-333fd90ee953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15a55ee-2a8a-4f00-a4ca-319d638973b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15a55ee-2a8a-4f00-a4ca-319d638973b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973892067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d7dbf5-8a95-4054-863c-197305c6c458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:48Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d75b3b-314c-4353-b779-3914ba0af946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d75b3b-314c-4353-b779-3914ba0af946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cf7b6d-fe94-4b1f-88c5-912088d7c3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cf7b6d-fe94-4b1f-88c5-912088d7c3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d7dbf5-8a95-4054-863c-197305c6c458', 'volume_name': 'volume-11d7dbf5-8a95-4054-863c-197305c6c458', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39135618-5765-4abf-8b8d-a72feeb2b89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39135618-5765-4abf-8b8d-a72feeb2b89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46596eb6-08ac-471c-882c-3c4915b9f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:48 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Volume 11d7dbf5-8a95-4054-863c-197305c6c458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d7dbf5-8a95-4054-863c-197305c6c458', 'volume_size': 1} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1973892067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d7dbf5-8a95-4054-863c-197305c6c458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:48Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Creating volume 11d7dbf5-8a95-4054-863c-197305c6c458 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:15:48 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:15:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:48 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 1073741824 Jun 29 03:15:48 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:49 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 1073741824" returned: 0 in 0.806s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:49 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 Jun 29 03:15:49 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:49 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458" returned: 0 in 0.616s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46596eb6-08ac-471c-882c-3c4915b9f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d7dbf5-8a95-4054-863c-197305c6c458', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da686977-c74d-45bc-a901-2ce66f98bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Volume volume-11d7dbf5-8a95-4054-863c-197305c6c458 (11d7dbf5-8a95-4054-863c-197305c6c458): created successfully Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da686977-c74d-45bc-a901-2ce66f98bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (62dcc63f-e0a3-4332-a28a-333fd90ee953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-240001c8-bdec-4a1a-b4e6-630a07a0072e tempest-VolumesActionsTest-1362134747 None] Created volume successfully. Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-11d7dbf5-8a95-4054-863c-197305c6c458-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Lock "cinder-11d7dbf5-8a95-4054-863c-197305c6c458-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-quobyte-11d7dbf5-8a95-4054-863c-197305c6c458" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-11d7dbf5-8a95-4054-863c-197305c6c458" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a39f7e7-9e9a-4741-8be7-4aa73a06c0d9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:50 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 Jun 29 03:15:50 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Flow 'volume_create_manager' (570cff61-dd98-44a2-921c-b5fd04e6894d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0be3e03-832b-415f-a518-9c32396cc1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0be3e03-832b-415f-a518-9c32396cc1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-598980795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae26478a-2224-4a95-8516-8de9c5948808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf13f58474ef453d8df2fc9ddf111195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:51Z,use_quota=True,user_id='ac49cd1d23284900a15b8612cfdf8432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a18e957-40da-41e8-8a80-c1c794bbc822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a18e957-40da-41e8-8a80-c1c794bbc822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57241977-aef2-4e29-93a9-acb961e14373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57241977-aef2-4e29-93a9-acb961e14373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae26478a-2224-4a95-8516-8de9c5948808', 'volume_name': 'volume-ae26478a-2224-4a95-8516-8de9c5948808', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156bf7bd-d206-4dc3-baaa-6e906d5ece30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156bf7bd-d206-4dc3-baaa-6e906d5ece30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe0567e-bc43-4e2b-a589-158a9a8ae395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Volume ae26478a-2224-4a95-8516-8de9c5948808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae26478a-2224-4a95-8516-8de9c5948808', 'volume_size': 1} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-598980795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae26478a-2224-4a95-8516-8de9c5948808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf13f58474ef453d8df2fc9ddf111195',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:51Z,use_quota=True,user_id='ac49cd1d23284900a15b8612cfdf8432',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Creating volume ae26478a-2224-4a95-8516-8de9c5948808 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:15:51 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:51 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 1073741824 Jun 29 03:15:51 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:51 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458" returned: 0 in 0.764s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:51 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458 Jun 29 03:15:51 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:51 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 1073741824" returned: 0 in 0.856s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:51 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 Jun 29 03:15:51 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:52 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-11d7dbf5-8a95-4054-863c-197305c6c458" returned: 0 in 0.646s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-11d7dbf5-8a95-4054-863c-197305c6c458" released by "delete_volume" :: held 1.454s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Created reservations ['4a0150eb-494f-40f9-bd22-5af6fa6af02a', '82666fee-9a99-47d4-802b-cf625befdfea', '8c54b229-a972-4899-b493-042cf74d0359', '0c2962a7-ac7e-4911-be5e-a47b92df55e1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:52 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:15:52 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:52 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808" returned: 0 in 0.642s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe0567e-bc43-4e2b-a589-158a9a8ae395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae26478a-2224-4a95-8516-8de9c5948808', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c668f7-864a-4ef2-9daf-840cd35ce641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:52 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Volume volume-ae26478a-2224-4a95-8516-8de9c5948808 (ae26478a-2224-4a95-8516-8de9c5948808): created successfully Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c668f7-864a-4ef2-9daf-840cd35ce641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Flow 'volume_create_manager' (570cff61-dd98-44a2-921c-b5fd04e6894d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b6e2eb01-13d8-4b69-9fa0-337ed33a8b3d tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Created volume successfully. Jun 29 03:15:52 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.653s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:15:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Deleted volume successfully. Jun 29 03:15:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f799f387-2e08-4869-bec4-e119a283b565 tempest-VolumesActionsTest-271990538 None] Lock "cinder-11d7dbf5-8a95-4054-863c-197305c6c458-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (52a78de3-39ef-401c-864e-3fd7a869e735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f58113c-afdb-44b9-9cf7-91f192798045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f58113c-afdb-44b9-9cf7-91f192798045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851790183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846ea8cf-6642-4d48-870e-daacbcf299a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:53Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52864dd-4839-441f-b4b9-d54d2ac13242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52864dd-4839-441f-b4b9-d54d2ac13242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b27400e-a0cd-4a80-b299-025c411f6ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b27400e-a0cd-4a80-b299-025c411f6ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846ea8cf-6642-4d48-870e-daacbcf299a0', 'volume_name': 'volume-846ea8cf-6642-4d48-870e-daacbcf299a0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb65315-b86c-459c-b46a-591f40a71e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb65315-b86c-459c-b46a-591f40a71e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1e21df-b6b3-46ab-9409-5bc2623d961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Volume 846ea8cf-6642-4d48-870e-daacbcf299a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846ea8cf-6642-4d48-870e-daacbcf299a0', 'volume_size': 1} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1851790183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846ea8cf-6642-4d48-870e-daacbcf299a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:53Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Creating volume 846ea8cf-6642-4d48-870e-daacbcf299a0 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:15:53 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:15:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:53 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 1073741824 Jun 29 03:15:53 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:54 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 1073741824" returned: 0 in 0.783s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:54 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 Jun 29 03:15:54 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:54 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0" returned: 0 in 0.638s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1e21df-b6b3-46ab-9409-5bc2623d961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846ea8cf-6642-4d48-870e-daacbcf299a0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e1f04a-f6a1-4b7a-b667-7a7f82279662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:54 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Volume volume-846ea8cf-6642-4d48-870e-daacbcf299a0 (846ea8cf-6642-4d48-870e-daacbcf299a0): created successfully Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10e1f04a-f6a1-4b7a-b667-7a7f82279662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (52a78de3-39ef-401c-864e-3fd7a869e735) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3ff1b7b6-c065-42ad-a846-ceb5621ca40d tempest-VolumesActionsTest-1362134747 None] Created volume successfully. Jun 29 03:15:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-846ea8cf-6642-4d48-870e-daacbcf299a0-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Lock "cinder-846ea8cf-6642-4d48-870e-daacbcf299a0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-quobyte-846ea8cf-6642-4d48-870e-daacbcf299a0" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:15:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-846ea8cf-6642-4d48-870e-daacbcf299a0" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:15:55 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00142b5-777a-4066-adfb-63875ba75149]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:15:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:55 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 Jun 29 03:15:55 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ecd4c2-fb00-489d-800a-da10f9337a06]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:56 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 Jun 29 03:15:56 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:56 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0" returned: 0 in 0.791s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:56 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0 Jun 29 03:15:56 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:56 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808" returned: 0 in 0.752s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.770s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-ae26478a-2224-4a95-8516-8de9c5948808', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df4decad-53b9-4e15-bcfd-e427b31b747d', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:15:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-0edd5bc6-a01c-4773-983c-8ee00aa5b693 req-4c802d26-74e2-4746-ad0f-84fdb4deff70 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] attachment_update completed successfully. Jun 29 03:15:57 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-846ea8cf-6642-4d48-870e-daacbcf299a0" returned: 0 in 0.656s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-846ea8cf-6642-4d48-870e-daacbcf299a0" released by "delete_volume" :: held 1.483s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Created reservations ['332d5aff-45b7-4480-b9a0-d236e3a3aec2', '731b209f-1f52-4a97-8e99-ac34c4f4d235', '040e5a67-eef3-4794-abed-619feefcd125', '7016e5c5-56a8-45e1-a9a9-9037abb86e8b'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:57 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:15:57 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:57 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.651s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:15:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Deleted volume successfully. Jun 29 03:15:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a0d9cf74-34ba-404d-80a8-ce78a3bb9520 tempest-VolumesActionsTest-271990538 None] Lock "cinder-846ea8cf-6642-4d48-870e-daacbcf299a0-delete_volume" released by "delete_volume" :: held 2.320s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (b45ef5aa-f3b3-45a2-8043-30630f8c61ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37550267-789e-470a-bc57-e0427cbb1c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37550267-789e-470a-bc57-e0427cbb1c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-619991474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:58Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc793cd-8c1b-4bf5-8d17-fa74e5cefead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afc793cd-8c1b-4bf5-8d17-fa74e5cefead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f59160-51cf-41ab-9a18-0c265bec7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f59160-51cf-41ab-9a18-0c265bec7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f', 'volume_name': 'volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec4634a-fa31-4d8d-b29b-1a62761053a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec4634a-fa31-4d8d-b29b-1a62761053a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ace4b01-a56b-4e13-8e41-9d53959b2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:58 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Volume 8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f', 'volume_size': 1} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-619991474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:15:58Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Creating volume 8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:15:58 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:15:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:58 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f 1073741824 Jun 29 03:15:58 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:59 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f 1073741824" returned: 0 in 0.788s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:15:59 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f Jun 29 03:15:59 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:15:59 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f" returned: 0 in 0.652s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ace4b01-a56b-4e13-8e41-9d53959b2050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c1465-9bbe-48ba-a183-6c6f6fc6af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:15:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Volume volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f (8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f): created successfully Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992c1465-9bbe-48ba-a183-6c6f6fc6af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:15:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (b45ef5aa-f3b3-45a2-8043-30630f8c61ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:15:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-87dab487-cfe9-41a5-82d4-c5dce60113d0 tempest-VolumesActionsTest-1362134747 None] Created volume successfully. Jun 29 03:16:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Lock "cinder-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Acquiring lock "cinder-quobyte-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddecb1f-9f78-4068-bad2-564adbba6c9e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:00 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f Jun 29 03:16:00 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:01 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f" returned: 0 in 0.759s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:01 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f Jun 29 03:16:01 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:01 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f" returned: 0 in 0.697s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Lock "cinder-quobyte-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f" released by "delete_volume" :: held 1.496s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Created reservations ['adb80a03-8c29-4da5-b4fd-211514afa494', '20687681-4290-4166-9f42-948e1729dee1', '5d9c18b7-8a09-4dca-95a4-db3001594367', '93a464cd-317a-4508-aea1-819e399042f9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:02 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:02 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:02 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.636s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Deleted volume successfully. Jun 29 03:16:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4ee6a2b6-e023-4fef-822e-a3a991ffa6a8 tempest-VolumesActionsTest-271990538 None] Lock "cinder-8c18bcee-3fb2-4bf9-913d-37a3e4c31b3f-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (e5f2d3bd-c28e-4970-a13e-b250bccc2501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ecbbaaf-ecc7-4fbd-a796-d3a2a55eaf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ecbbaaf-ecc7-4fbd-a796-d3a2a55eaf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666628641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45efb458-a214-4722-bf00-b7e66081b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:03Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5c54d9-04d0-4b0f-9d3a-c5e9fc0b26d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a5c54d9-04d0-4b0f-9d3a-c5e9fc0b26d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44e760a-2eea-4704-8753-e7a6430b5989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44e760a-2eea-4704-8753-e7a6430b5989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45efb458-a214-4722-bf00-b7e66081b154', 'volume_name': 'volume-45efb458-a214-4722-bf00-b7e66081b154', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a3e618-df25-4879-8dd0-23d4f4d3d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a3e618-df25-4879-8dd0-23d4f4d3d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffb4f8f-2d22-4396-abbc-4036f7676de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:03 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Volume 45efb458-a214-4722-bf00-b7e66081b154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45efb458-a214-4722-bf00-b7e66081b154', 'volume_size': 1} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666628641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45efb458-a214-4722-bf00-b7e66081b154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eadefd2ec937447ab1032f452abf1732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:03Z,use_quota=True,user_id='4a7d22e1180f4c7da10f25b3c002d943',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Creating volume 45efb458-a214-4722-bf00-b7e66081b154 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:03 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:03 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 1073741824 Jun 29 03:16:03 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-001c14c8-5f8d-4283-99ad-dc2ae3edd280 req-e5aaf606-4d04-4f56-90bd-707370789210 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Terminate volume connection completed successfully. Jun 29 03:16:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-001c14c8-5f8d-4283-99ad-dc2ae3edd280 req-e5aaf606-4d04-4f56-90bd-707370789210 tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Deleting attachment df4decad-53b9-4e15-bcfd-e427b31b747d. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:16:04 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 1073741824" returned: 0 in 0.831s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:04 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 Jun 29 03:16:04 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:04 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154" returned: 0 in 0.643s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffb4f8f-2d22-4396-abbc-4036f7676de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45efb458-a214-4722-bf00-b7e66081b154', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad44b01-a6f2-4805-8d72-fba4403e2f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Volume volume-45efb458-a214-4722-bf00-b7e66081b154 (45efb458-a214-4722-bf00-b7e66081b154): created successfully Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad44b01-a6f2-4805-8d72-fba4403e2f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Flow 'volume_create_manager' (e5f2d3bd-c28e-4970-a13e-b250bccc2501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ebca0809-98dc-4243-b6ef-958f6769d209 tempest-VolumesActionsTest-1362134747 None] Created volume successfully. Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Acquiring lock "cinder-ae26478a-2224-4a95-8516-8de9c5948808-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "cinder-ae26478a-2224-4a95-8516-8de9c5948808-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Acquiring lock "cinder-quobyte-ae26478a-2224-4a95-8516-8de9c5948808" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "cinder-quobyte-ae26478a-2224-4a95-8516-8de9c5948808" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[76274a9a-53f8-4291-8fe2-ddde3ec24f9d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:05 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 Jun 29 03:16:05 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "cinder-45efb458-a214-4722-bf00-b7e66081b154-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-45efb458-a214-4722-bf00-b7e66081b154-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "cinder-quobyte-45efb458-a214-4722-bf00-b7e66081b154" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-quobyte-45efb458-a214-4722-bf00-b7e66081b154" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2aa54-2cd7-4a37-9393-8470d5b29be9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:06 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 Jun 29 03:16:06 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:06 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808" returned: 0 in 0.762s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:06 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808 Jun 29 03:16:06 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:06 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154" returned: 0 in 0.811s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:06 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154 Jun 29 03:16:06 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:06 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ae26478a-2224-4a95-8516-8de9c5948808" returned: 0 in 0.668s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "cinder-quobyte-ae26478a-2224-4a95-8516-8de9c5948808" released by "delete_volume" :: held 1.476s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Created reservations ['18e3d633-60d6-4614-bb3a-6ef6dee2f053', 'b180fbb0-d261-47a9-9eda-25aa68056f0e', '8c638f84-db88-4b15-bcb6-834329c7bd1d', 'c06f7c14-2a9f-4760-91db-647d0d2dc1c4'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:07 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:07 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:07 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-45efb458-a214-4722-bf00-b7e66081b154" returned: 0 in 0.640s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-quobyte-45efb458-a214-4722-bf00-b7e66081b154" released by "delete_volume" :: held 1.502s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Created reservations ['4f3c3506-918b-4dff-9a98-55a0128523fb', '60b118b0-82fd-4134-a2ff-5102d843fc58', 'e9687fd8-3529-450c-8144-ae9ff98d4b77', '12c738e5-84eb-4b21-85de-f6ca70a3b790'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:07 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:07 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:07 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.698s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Deleted volume successfully. Jun 29 03:16:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2d568fdb-f7f0-479a-84d8-a8cde6a077be tempest-TestServerVolumeAttachScenarioOldVersion-1008310072 None] Lock "cinder-ae26478a-2224-4a95-8516-8de9c5948808-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:08 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.680s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:08 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Deleted volume successfully. Jun 29 03:16:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f18a8d2e-b6c9-4840-b164-ae236428b074 tempest-VolumesActionsTest-1362134747 None] Lock "cinder-45efb458-a214-4722-bf00-b7e66081b154-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:17 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:17 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:17 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=60,cinder:UPDATE=81,cinder:INSERT=15,cinder:DELETE=8 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:16:18 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=83,cinder:SELECT=66,cinder:DELETE=6,cinder:INSERT=22 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:16:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.720s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:18 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:16:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:16:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Flow 'volume_create_manager' (2702a078-6f75-4e1f-b7da-c492236ef34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033edd8e-1445-4415-8fd1-bf1725e11675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033edd8e-1445-4415-8fd1-bf1725e11675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-644213704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f7b22d-e400-45a6-a20e-4b57fc647693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45768128eb454fdfb25bf693991ffc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:21Z,use_quota=True,user_id='0eb7847d303c4958ba5682c13e4f6452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03407a33-588f-4804-9765-93c91f780cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03407a33-588f-4804-9765-93c91f780cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39f2476-f7f8-4191-adc6-b94860b1d0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39f2476-f7f8-4191-adc6-b94860b1d0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f7b22d-e400-45a6-a20e-4b57fc647693', 'volume_name': 'volume-47f7b22d-e400-45a6-a20e-4b57fc647693', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ece38-f7ad-49c3-a5e6-4238fe94b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2ece38-f7ad-49c3-a5e6-4238fe94b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b25f8d7-07da-4eee-86b7-96c162c361be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:21 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Volume 47f7b22d-e400-45a6-a20e-4b57fc647693: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f7b22d-e400-45a6-a20e-4b57fc647693', 'volume_size': 1} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-644213704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f7b22d-e400-45a6-a20e-4b57fc647693,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45768128eb454fdfb25bf693991ffc90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:21Z,use_quota=True,user_id='0eb7847d303c4958ba5682c13e4f6452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Creating volume 47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:21 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:21 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 1073741824 Jun 29 03:16:21 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:22 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 1073741824" returned: 0 in 0.828s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:22 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 Jun 29 03:16:22 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:23 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693" returned: 0 in 0.693s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b25f8d7-07da-4eee-86b7-96c162c361be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f7b22d-e400-45a6-a20e-4b57fc647693', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf9b6c1-e6fc-4430-87e8-2d0f14c81db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:23 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Volume volume-47f7b22d-e400-45a6-a20e-4b57fc647693 (47f7b22d-e400-45a6-a20e-4b57fc647693): created successfully Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf9b6c1-e6fc-4430-87e8-2d0f14c81db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Flow 'volume_create_manager' (2702a078-6f75-4e1f-b7da-c492236ef34e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:23 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a2ed0305-cb2e-4266-a7e4-77a9023a4025 tempest-SnapshotMetadataTestJSON-887182198 None] Created volume successfully. Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Creating offline snapshot adf32a8d-eacf-409b-ac98-b56aaf9f656b of volume 47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[277fb5b2-0ea2-45bb-9ce4-5a95008aca08]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:23 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 Jun 29 03:16:23 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:24 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693" returned: 0 in 0.796s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:24 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b 1G Jun 29 03:16:24 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:25 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b 1G" returned: 0 in 0.817s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f7b22d-e400-45a6-a20e-4b57fc647693 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:25 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f7b22d-e400-45a6-a20e-4b57fc647693 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b Jun 29 03:16:25 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:26 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f7b22d-e400-45a6-a20e-4b57fc647693 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b" returned: 0 in 0.679s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:26 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b is being set with open permissions: ugo+rw Jun 29 03:16:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:26 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b Jun 29 03:16:26 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:26 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:26 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info Jun 29 03:16:26 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:27 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info" returned: 0 in 0.672s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:27 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info is being set with open permissions: ugo+rw Jun 29 03:16:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:27 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info Jun 29 03:16:27 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:28 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.info" returned: 0 in 0.633s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c1bbae76-f86c-4ac5-945b-0c05478030c0 tempest-SnapshotMetadataTestJSON-887182198 None] Create snapshot completed successfully Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "cinder-adf32a8d-eacf-409b-ac98-b56aaf9f656b-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-adf32a8d-eacf-409b-ac98-b56aaf9f656b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "cinder-quobyte-47f7b22d-e400-45a6-a20e-4b57fc647693" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-quobyte-47f7b22d-e400-45a6-a20e-4b57fc647693" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "cinder-quobyte-adf32a8d-eacf-409b-ac98-b56aaf9f656b" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-quobyte-adf32a8d-eacf-409b-ac98-b56aaf9f656b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Deleting offline snapshot adf32a8d-eacf-409b-ac98-b56aaf9f656b of volume 47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] snapshot_file for this snap is: volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c88837-d08b-4bb9-bfff-9b63edf944b9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:29 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b Jun 29 03:16:29 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:30 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b" returned: 0 in 0.892s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f7b22d-e400-45a6-a20e-4b57fc647693(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:16:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f0429d-c4f4-4bce-a5f3-f87e74474e67]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:30 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 Jun 29 03:16:30 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:31 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693" returned: 0 in 0.857s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:31 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b Jun 29 03:16:31 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:32 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b" returned: 0 in 0.819s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:32 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b Jun 29 03:16:32 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:33 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693.adf32a8d-eacf-409b-ac98-b56aaf9f656b" returned: 0 in 0.703s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-quobyte-adf32a8d-eacf-409b-ac98-b56aaf9f656b" released by "_delete_snapshot" :: held 3.380s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-quobyte-47f7b22d-e400-45a6-a20e-4b57fc647693" released by "delete_snapshot" :: held 3.409s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:33 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Created reservations ['59f7611a-21cd-41b8-b48e-eba08691fc67', '95c8522e-79cd-449d-a0a6-9441584de21c', '9f3599af-0e46-477b-87fa-6fa7be3a9fea', 'effd8aa3-c25b-48f9-9aa8-7c150772cb58'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Delete snapshot completed successfully. Jun 29 03:16:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4826c221-4920-460b-af43-a89667134691 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-adf32a8d-eacf-409b-ac98-b56aaf9f656b-delete_snapshot" released by "delete_snapshot" :: held 3.564s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "cinder-47f7b22d-e400-45a6-a20e-4b57fc647693-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-47f7b22d-e400-45a6-a20e-4b57fc647693-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "cinder-quobyte-47f7b22d-e400-45a6-a20e-4b57fc647693" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-quobyte-47f7b22d-e400-45a6-a20e-4b57fc647693" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[88315e14-7b87-4dfe-9c55-07d03c8f20c7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:34 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 Jun 29 03:16:34 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:34 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693" returned: 0 in 0.832s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:35 devstack sudo[108948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693 Jun 29 03:16:35 devstack sudo[108948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:35 devstack sudo[108948]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-47f7b22d-e400-45a6-a20e-4b57fc647693" returned: 0 in 0.640s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-quobyte-47f7b22d-e400-45a6-a20e-4b57fc647693" released by "delete_volume" :: held 1.551s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Created reservations ['817a3677-f68f-4253-a19a-57a390bcb3dc', '9fe57dd5-0045-4967-9e02-5794661a6093', '5d080068-6f76-4e3d-afb6-36558c4492d1', 'a73668b3-53d0-47e0-b1f8-89ff2e8ba98c'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:35 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:35 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:36 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.682s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:36 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Deleted volume successfully. Jun 29 03:16:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8fcdbb-0f83-4076-9d6a-1f6587777216 tempest-SnapshotMetadataTestJSON-887182198 None] Lock "cinder-47f7b22d-e400-45a6-a20e-4b57fc647693-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Flow 'volume_create_manager' (c0262774-89bd-40ba-a825-fcabd275d79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f90d31-9400-4e8b-ad01-e2d028460a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f90d31-9400-4e8b-ad01-e2d028460a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-374971441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca9f89c-a4e2-4829-b782-461ea0c08089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5c6ac1374f4f7ca7e1fbb0905cab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:40Z,use_quota=True,user_id='a168690ff043468881757670832b95a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eba52d2-c9e1-43c3-a02a-52e559aa9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eba52d2-c9e1-43c3-a02a-52e559aa9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f4eb52-8479-499b-a396-87284b4713c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f4eb52-8479-499b-a396-87284b4713c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ca9f89c-a4e2-4829-b782-461ea0c08089', 'volume_name': 'volume-3ca9f89c-a4e2-4829-b782-461ea0c08089', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ee4490-c0c1-4afd-b72f-f5ad65247ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ee4490-c0c1-4afd-b72f-f5ad65247ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50907ab4-72b6-4314-81fe-93e72f1fd9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:40 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Volume 3ca9f89c-a4e2-4829-b782-461ea0c08089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ca9f89c-a4e2-4829-b782-461ea0c08089', 'volume_size': 1} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-374971441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ca9f89c-a4e2-4829-b782-461ea0c08089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5c6ac1374f4f7ca7e1fbb0905cab45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:40Z,use_quota=True,user_id='a168690ff043468881757670832b95a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Creating volume 3ca9f89c-a4e2-4829-b782-461ea0c08089 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:40 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:40 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 1073741824 Jun 29 03:16:40 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:41 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 1073741824" returned: 0 in 0.899s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:41 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 Jun 29 03:16:41 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089" returned: 0 in 0.650s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:42 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50907ab4-72b6-4314-81fe-93e72f1fd9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ca9f89c-a4e2-4829-b782-461ea0c08089', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66c79f6-970d-4e56-b37a-0d0ce1b2f4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Volume volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 (3ca9f89c-a4e2-4829-b782-461ea0c08089): created successfully Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66c79f6-970d-4e56-b37a-0d0ce1b2f4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Flow 'volume_create_manager' (c0262774-89bd-40ba-a825-fcabd275d79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-355ec340-dbf2-4eda-906f-21b041868985 tempest-AbsoluteLimitsTests-95489662 None] Created volume successfully. Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Acquiring lock "cinder-3ca9f89c-a4e2-4829-b782-461ea0c08089-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Lock "cinder-3ca9f89c-a4e2-4829-b782-461ea0c08089-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Acquiring lock "cinder-quobyte-3ca9f89c-a4e2-4829-b782-461ea0c08089" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Lock "cinder-quobyte-3ca9f89c-a4e2-4829-b782-461ea0c08089" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fcc9a1-c966-4e98-9788-8d266804b9c8]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:42 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 Jun 29 03:16:42 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:43 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089" returned: 0 in 0.811s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:43 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089 Jun 29 03:16:43 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:44 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-3ca9f89c-a4e2-4829-b782-461ea0c08089" returned: 0 in 0.682s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Lock "cinder-quobyte-3ca9f89c-a4e2-4829-b782-461ea0c08089" released by "delete_volume" :: held 1.544s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Created reservations ['4f65fb42-af7c-4b42-8f8f-f63583fcd2a8', 'd3fa93aa-bc82-4d98-9a65-8be897123919', '04823282-e873-48c5-93c8-364e31bf6448', '086d073d-4b22-4be0-ab25-2b84a7111186'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:44 devstack sudo[109008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:44 devstack sudo[109008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:45 devstack sudo[109008]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.705s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:45 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:45 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Deleted volume successfully. Jun 29 03:16:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7686a29a-791e-468d-b482-074b39e6b9b5 tempest-AbsoluteLimitsTests-95489662 None] Lock "cinder-3ca9f89c-a4e2-4829-b782-461ea0c08089-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (b8e877e7-ba14-4841-ba6d-6ba6430d6a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32576b7-d476-4a88-ace6-0d7ff7c689f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e32576b7-d476-4a88-ace6-0d7ff7c689f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-718811461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef4b0ae-1357-49c6-ad0c-478d9264d0fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:49Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31968a81-47f0-4539-99c2-da2658b3b69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31968a81-47f0-4539-99c2-da2658b3b69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e751f69-4f33-498e-b887-cc6e577008ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e751f69-4f33-498e-b887-cc6e577008ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef4b0ae-1357-49c6-ad0c-478d9264d0fd', 'volume_name': 'volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58aabbf6-7039-4e22-a6b2-3b4ad5b95424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58aabbf6-7039-4e22-a6b2-3b4ad5b95424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b26c015-f3b9-4767-8917-04b6b7753c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Volume 4ef4b0ae-1357-49c6-ad0c-478d9264d0fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd', 'volume_size': 1} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-718811461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef4b0ae-1357-49c6-ad0c-478d9264d0fd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:49Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Creating volume 4ef4b0ae-1357-49c6-ad0c-478d9264d0fd {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:49 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:49 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd 1073741824 Jun 29 03:16:49 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Flow 'volume_create_manager' (b5ef82c2-4c2e-4387-948c-f769dfd917ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6023c6ae-ace0-4b76-b206-e0e95725bb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6023c6ae-ace0-4b76-b206-e0e95725bb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-869615051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1a04f-f34a-4127-a9d7-929820e7e804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07d26972e7e4a06871a5a6b007f21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:50Z,use_quota=True,user_id='350b08b9640b49c383744da264ad8a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51a7e9b-7235-47b5-8d6f-2c10f767980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b51a7e9b-7235-47b5-8d6f-2c10f767980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ace02-71d0-4b56-a4ce-4ef7b6db9f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:16:50 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd 1073741824" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:50 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd Jun 29 03:16:50 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (582ace02-71d0-4b56-a4ce-4ef7b6db9f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bae1a04f-f34a-4127-a9d7-929820e7e804', 'volume_name': 'volume-bae1a04f-f34a-4127-a9d7-929820e7e804', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb7952b-e418-4c70-b2e0-9c99f6012020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb7952b-e418-4c70-b2e0-9c99f6012020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c9b903-8216-4c91-92e6-bcf79546e48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:50 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Volume bae1a04f-f34a-4127-a9d7-929820e7e804: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bae1a04f-f34a-4127-a9d7-929820e7e804', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Trying to clone bae1a04f-f34a-4127-a9d7-929820e7e804 from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:16:50 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[87369a1f-dfd9-4c77-9d81-f59b62ac5183]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:51 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD Jun 29 03:16:51 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:51 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b26c015-f3b9-4767-8917-04b6b7753c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35715357-c38b-4334-be23-0171a26cf963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Volume volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd (4ef4b0ae-1357-49c6-ad0c-478d9264d0fd): created successfully Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35715357-c38b-4334-be23-0171a26cf963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (b8e877e7-ba14-4841-ba6d-6ba6430d6a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:51 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b8ab869b-09f5-4c4b-a173-fe034207ad40 tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:16:51 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 is fetched for user 350b08b9640b49c383744da264ad8a6e. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8568f097-f63e-46c3-b974-199e8f01d1b5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:51 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD Jun 29 03:16:51 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (2cccea13-719c-42da-b1cd-785df0dbf4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b30d3eb-173e-4e81-9072-d038a14a19d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b30d3eb-173e-4e81-9072-d038a14a19d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-415418728',display_name='tempest-VolumesGetTest-Volume-890337752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe13717-9ef1-4072-9ef8-ff057df83af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:52Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8150be-32fa-4a8c-bc6c-e91f5eea82cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8150be-32fa-4a8c-bc6c-e91f5eea82cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee483cd-d4ae-44f2-a8c2-28256b88bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee483cd-d4ae-44f2-a8c2-28256b88bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe13717-9ef1-4072-9ef8-ff057df83af0', 'volume_name': 'volume-bfe13717-9ef1-4072-9ef8-ff057df83af0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad246bf-6f07-4cf7-803c-9a37e9f5cfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad246bf-6f07-4cf7-803c-9a37e9f5cfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd151d4-2708-4667-9405-ef5f94a85b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:52 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Volume bfe13717-9ef1-4072-9ef8-ff057df83af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe13717-9ef1-4072-9ef8-ff057df83af0', 'volume_size': 1} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-415418728',display_name='tempest-VolumesGetTest-Volume-890337752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe13717-9ef1-4072-9ef8-ff057df83af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:52Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Creating volume bfe13717-9ef1-4072-9ef8-ff057df83af0 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:52 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:52 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 1073741824 Jun 29 03:16:52 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:52 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD" returned: 0 in 0.797s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:53 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 1073741824" returned: 0 in 0.809s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:53 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 Jun 29 03:16:53 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:53 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0" returned: 0 in 0.621s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-869615051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1a04f-f34a-4127-a9d7-929820e7e804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07d26972e7e4a06871a5a6b007f21ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:50Z,use_quota=True,user_id='350b08b9640b49c383744da264ad8a6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Creating volume bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:53 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:53 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 1073741824 Jun 29 03:16:53 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffd151d4-2708-4667-9405-ef5f94a85b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe13717-9ef1-4072-9ef8-ff057df83af0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcbcd18-3a5b-46c0-8814-0b1504d28e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Volume volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 (bfe13717-9ef1-4072-9ef8-ff057df83af0): created successfully Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcbcd18-3a5b-46c0-8814-0b1504d28e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (2cccea13-719c-42da-b1cd-785df0dbf4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9ad9b13c-b0f3-4db1-94d3-afc23f2b77b7 tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-bfe13717-9ef1-4072-9ef8-ff057df83af0-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Lock "cinder-bfe13717-9ef1-4072-9ef8-ff057df83af0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-bfe13717-9ef1-4072-9ef8-ff057df83af0" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-bfe13717-9ef1-4072-9ef8-ff057df83af0" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61926cd-32bd-406d-a198-7e5b70151183]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:54 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 1073741824" returned: 0 in 0.842s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:54 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 Jun 29 03:16:54 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:54 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:16:54 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:55 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 0.645s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:16:55 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0" returned: 0 in 0.791s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:55 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0 Jun 29 03:16:55 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Attempting download of ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume bae1a04f-f34a-4127-a9d7-929820e7e804. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9345a43-3eb4-469d-b758-076ba372dc1d]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:55 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d Jun 29 03:16:55 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:55 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bfe13717-9ef1-4072-9ef8-ff057df83af0" returned: 0 in 0.659s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-bfe13717-9ef1-4072-9ef8-ff057df83af0" released by "delete_volume" :: held 1.489s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Created reservations ['73bc0e24-875a-4af8-9709-1ad1fa290aa3', '05340dbc-2528-4e0f-a563-1ffa61c345bd', '8df07628-c782-401d-a1ec-a5658dd75f93', 'afce728b-3481-4e4c-9fcd-2a68ceb09ef5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:56 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:56 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:56 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d" returned: 0 in 0.759s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:56 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d Jun 29 03:16:56 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Lock "cinder-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:16:56 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:56 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc61c5f-8d31-4eea-a91c-ddfc101d0174]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dacfca9b-4550-4aa1-829d-8bd5ac393402 tempest-VolumesGetTest-253327212 None] Lock "cinder-bfe13717-9ef1-4072-9ef8-ff057df83af0-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:56 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d" returned: 1 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_dhxoh05d' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dca88b-efc3-4dea-b8d5-802e21f09700]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:16:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:56 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd Jun 29 03:16:56 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:57 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD Jun 29 03:16:57 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:57 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:57 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd Jun 29 03:16:57 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:57 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD" returned: 0 in 0.725s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:57 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 was qcow2, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:16:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:57 devstack sudo[109081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:16:57 devstack sudo[109081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:58 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd" returned: 0 in 0.647s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd" released by "delete_volume" :: held 1.453s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Created reservations ['9f03d63d-ae42-4c18-a13d-d05d90589a70', '7381e0b6-c72e-43d1-877b-254ed1cdf6f9', '1336c709-9f53-43d4-a616-3aee8a40e516', '66bbd0ac-4409-4c39-9361-228c008f4573'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:58 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:16:58 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:59 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.661s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:16:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-01381fd3-3523-4cb2-8ff5-812e57dbccb8 tempest-VolumesGetTest-253327212 None] Lock "cinder-4ef4b0ae-1357-49c6-ad0c-478d9264d0fd-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (5e4599e7-fafc-42bf-9f2f-89d16523190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b34dec-4247-49e8-8b24-c78be31fb151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93b34dec-4247-49e8-8b24-c78be31fb151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1650822224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612cbde0-38c7-4447-8598-429c97b8a660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:59Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3923eed-c7fe-4ef7-b8f8-98e47aba5247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3923eed-c7fe-4ef7-b8f8-98e47aba5247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:59 devstack sudo[109081]: pam_unix(sudo:session): session closed for user root Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89d5d90-8683-487e-b4ed-6e026111a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89d5d90-8683-487e-b4ed-6e026111a62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612cbde0-38c7-4447-8598-429c97b8a660', 'volume_name': 'volume-612cbde0-38c7-4447-8598-429c97b8a660', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54f4c2c-ee35-4da1-bda6-24368849ce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54f4c2c-ee35-4da1-bda6-24368849ce5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc13642-ed76-45f8-b2fa-cb668e421c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:16:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Volume 612cbde0-38c7-4447-8598-429c97b8a660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612cbde0-38c7-4447-8598-429c97b8a660', 'volume_size': 1} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1650822224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612cbde0-38c7-4447-8598-429c97b8a660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:16:59Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Creating volume 612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:16:59 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 1.958s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_r0kort_8devstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:16:59 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Converted 112.00 MB image at 57.16 MB/s Jun 29 03:16:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:16:59 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 1073741824 Jun 29 03:16:59 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:16:59 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 1G Jun 29 03:16:59 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:00 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 1G" returned: 0 in 0.724s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[82518c33-8868-48d8-90b0-26ad7a5bacea]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:00 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 1073741824" returned: 0 in 0.795s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:00 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:00 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:00 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:17:00 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:01 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.621s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc13642-ed76-45f8-b2fa-cb668e421c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612cbde0-38c7-4447-8598-429c97b8a660', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5247adc3-6806-4527-98c0-b64053bab55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:01 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Volume volume-612cbde0-38c7-4447-8598-429c97b8a660 (612cbde0-38c7-4447-8598-429c97b8a660): created successfully Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5247adc3-6806-4527-98c0-b64053bab55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (5e4599e7-fafc-42bf-9f2f-89d16523190a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-25c227cc-52ee-4b25-abff-82373873a4ae tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:17:01 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 0.770s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:01 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:17:01 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:01 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 1 in 0.746s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Downloaded image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume bae1a04f-f34a-4127-a9d7-929820e7e804 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 for user 350b08b9640b49c383744da264ad8a6e is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Marking volume bae1a04f-f34a-4127-a9d7-929820e7e804 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Copying metadata from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 to bae1a04f-f34a-4127-a9d7-929820e7e804. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:17:01 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Creating volume glance metadata for volume bae1a04f-f34a-4127-a9d7-929820e7e804 backed by image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91c9b903-8216-4c91-92e6-bcf79546e48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae1a04f-f34a-4127-a9d7-929820e7e804', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc01c1d-189d-4458-966a-8d759a110ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Volume volume-bae1a04f-f34a-4127-a9d7-929820e7e804 (bae1a04f-f34a-4127-a9d7-929820e7e804): created successfully Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc01c1d-189d-4458-966a-8d759a110ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Flow 'volume_create_manager' (b5ef82c2-4c2e-4387-948c-f769dfd917ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8635088f-bfa7-47f0-af7a-5801f0101038 tempest-TestShelveInstance-1448662494 None] Created volume successfully. Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (619ffcf9-6c15-4b93-b2e3-ac8263d5d3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5460fad-4c52-40bd-9508-c07c771b6a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5460fad-4c52-40bd-9508-c07c771b6a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-712998921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da84e935-1d6d-452c-99ee-9c9a4aaef874,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=612cbde0-38c7-4447-8598-429c97b8a660,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:02Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718e966b-745d-4350-9b0e-104a2336b981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (718e966b-745d-4350-9b0e-104a2336b981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cfe263-f56d-4573-822a-8f2d3cc66ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4cfe263-f56d-4573-822a-8f2d3cc66ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'da84e935-1d6d-452c-99ee-9c9a4aaef874', 'volume_name': 'volume-da84e935-1d6d-452c-99ee-9c9a4aaef874', 'volume_size': 1, 'source_volid': '612cbde0-38c7-4447-8598-429c97b8a660', 'source_volstatus': 'available'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44688fc5-4db1-430a-a6ca-8d86fdbacfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44688fc5-4db1-430a-a6ca-8d86fdbacfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbf57e0-41d1-4cde-83b2-41b053f67661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Volume da84e935-1d6d-452c-99ee-9c9a4aaef874: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-da84e935-1d6d-452c-99ee-9c9a4aaef874', 'volume_size': 1, 'source_volid': '612cbde0-38c7-4447-8598-429c97b8a660', 'source_volstatus': 'available'} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:02 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Cloning volume 612cbde0-38c7-4447-8598-429c97b8a660 to volume da84e935-1d6d-452c-99ee-9c9a4aaef874 Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Creating offline snapshot 9f03dc51-4387-4352-8ef6-9728bd8c0281 of volume 612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00728d1-9619-447b-968d-f2e7de1edb9d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:02 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:02 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:03 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:03 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 1G Jun 29 03:17:03 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:03 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 1G" returned: 0 in 0.882s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612cbde0-38c7-4447-8598-429c97b8a660 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:03 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612cbde0-38c7-4447-8598-429c97b8a660 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 Jun 29 03:17:03 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:04 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-612cbde0-38c7-4447-8598-429c97b8a660 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281" returned: 0 in 0.721s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:04 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 is being set with open permissions: ugo+rw Jun 29 03:17:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:04 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 Jun 29 03:17:04 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:05 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281" returned: 0 in 0.618s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:05 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info Jun 29 03:17:05 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:05 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info" returned: 0 in 0.621s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:05 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info is being set with open permissions: ugo+rw Jun 29 03:17:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:05 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info Jun 29 03:17:05 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:06 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.info" returned: 0 in 0.613s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-da84e935-1d6d-452c-99ee-9c9a4aaef874" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-da84e935-1d6d-452c-99ee-9c9a4aaef874" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] snapshot: 9f03dc51-4387-4352-8ef6-9728bd8c0281, volume: da84e935-1d6d-452c-99ee-9c9a4aaef874, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211dbcf-8674-4096-9951-6e197bedec12]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:06 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 Jun 29 03:17:06 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:07 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281" returned: 0 in 0.800s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612cbde0-38c7-4447-8598-429c97b8a660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:17:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:17:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:17:07 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df4df9d-f46a-428e-8733-896f1f5c9adb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:07 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:07 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:08 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.736s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:08 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:17:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:08 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 Jun 29 03:17:08 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:13 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874" returned: 0 in 5.824s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:14 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dbca44-49a0-436e-aad0-9db7b353d7c5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:14 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:14 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:14 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.917s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:14 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:17:14 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Converted 1024.00 MB image at 175.77 MB/s Jun 29 03:17:14 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 is being set with open permissions: ugo+rw Jun 29 03:17:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:14 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 Jun 29 03:17:14 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=53,cinder:UPDATE=56,cinder:INSERT=20,cinder:DELETE=7 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:17:15 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874" returned: 0 in 0.656s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-da84e935-1d6d-452c-99ee-9c9a4aaef874" released by "_copy_volume_from_snapshot" :: held 9.022s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-9f03dc51-4387-4352-8ef6-9728bd8c0281" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-9f03dc51-4387-4352-8ef6-9728bd8c0281" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Deleting offline snapshot 9f03dc51-4387-4352-8ef6-9728bd8c0281 of volume 612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] snapshot_file for this snap is: volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52ba39e-b63b-4d74-9d6f-33f707bb7f8f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:15 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 Jun 29 03:17:15 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:16 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281" returned: 0 in 0.783s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-612cbde0-38c7-4447-8598-429c97b8a660(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:17:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1683c-9dbf-4f91-a0ad-696803c396bd]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:16 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:16 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:17 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.721s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:17 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 Jun 29 03:17:17 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:17:17 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281" returned: 0 in 0.696s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:17 devstack sudo[109208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281 Jun 29 03:17:17 devstack sudo[109208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:18 devstack sudo[109208]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660.9f03dc51-4387-4352-8ef6-9728bd8c0281" returned: 0 in 0.652s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-9f03dc51-4387-4352-8ef6-9728bd8c0281" released by "_delete_snapshot" :: held 2.944s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=55,cinder:UPDATE=65,cinder:INSERT=22,cinder:DELETE=4 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.374s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.841s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccbf57e0-41d1-4cde-83b2-41b053f67661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da84e935-1d6d-452c-99ee-9c9a4aaef874', 'volume_size': 1, 'source_volid': '612cbde0-38c7-4447-8598-429c97b8a660', 'source_volstatus': 'available'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62064c8-479f-4d9f-896e-5b742d75536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4810dafa-1dd9-40a4-8bc0-4e35344ec6fb]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:18 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Volume volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 (da84e935-1d6d-452c-99ee-9c9a4aaef874): created successfully Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62064c8-479f-4d9f-896e-5b742d75536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (619ffcf9-6c15-4b93-b2e3-ac8263d5d3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:18 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5119f309-0e1d-4bbe-9297-390c95e10fc5 tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:17:18 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:17:18 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:19 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 0.784s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:19 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:17:19 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:20 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 1 in 0.746s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.567s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-bae1a04f-f34a-4127-a9d7-929820e7e804', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a92493b9-241f-403b-946c-047f2500b08f', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:17:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-cf92c0d2-168e-41bf-b6a1-a7920ca7690f req-2952cc43-f210-4875-9e3f-1231d0a665cc tempest-TestShelveInstance-1448662494 None] attachment_update completed successfully. Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (629ec5ba-0597-4212-a0ae-099228319886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6c39c0-ad29-4037-8d69-2717fb0d94a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6c39c0-ad29-4037-8d69-2717fb0d94a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686007241',display_name='tempest-VolumesGetTest-Volume-2087407181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429716ac-198f-47dc-afc1-98061cef3e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:20Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855ef6ef-cd0f-4ef1-b34f-e098f3d44924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (855ef6ef-cd0f-4ef1-b34f-e098f3d44924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75159d2d-d731-42ab-bc43-84a005782750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75159d2d-d731-42ab-bc43-84a005782750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429716ac-198f-47dc-afc1-98061cef3e3b', 'volume_name': 'volume-429716ac-198f-47dc-afc1-98061cef3e3b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c696ad-954b-4188-a6ef-ac2e06a9bb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76c696ad-954b-4188-a6ef-ac2e06a9bb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f59492-2453-4b45-8ce6-e74f88a1a173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:20 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Volume 429716ac-198f-47dc-afc1-98061cef3e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429716ac-198f-47dc-afc1-98061cef3e3b', 'volume_size': 1} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-686007241',display_name='tempest-VolumesGetTest-Volume-2087407181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429716ac-198f-47dc-afc1-98061cef3e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:20Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Creating volume 429716ac-198f-47dc-afc1-98061cef3e3b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:17:20 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:17:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:20 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b 1073741824 Jun 29 03:17:20 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:21 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b 1073741824" returned: 0 in 0.873s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:21 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b Jun 29 03:17:21 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:21 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b" returned: 0 in 0.648s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:21 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:17:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73f59492-2453-4b45-8ce6-e74f88a1a173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429716ac-198f-47dc-afc1-98061cef3e3b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd86e37-1113-49d8-9672-b160bd8816ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Volume volume-429716ac-198f-47dc-afc1-98061cef3e3b (429716ac-198f-47dc-afc1-98061cef3e3b): created successfully Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd86e37-1113-49d8-9672-b160bd8816ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (629ec5ba-0597-4212-a0ae-099228319886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-388ae51c-e96b-47df-9af2-f1e61ecebaaa tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-429716ac-198f-47dc-afc1-98061cef3e3b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Lock "cinder-429716ac-198f-47dc-afc1-98061cef3e3b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-429716ac-198f-47dc-afc1-98061cef3e3b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-429716ac-198f-47dc-afc1-98061cef3e3b" acquired by "delete_volume" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c068dbb-df87-4cf3-be83-564aca7231eb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:22 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b Jun 29 03:17:22 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:23 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b" returned: 0 in 0.774s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:23 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b Jun 29 03:17:23 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:24 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-429716ac-198f-47dc-afc1-98061cef3e3b" returned: 0 in 0.663s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-429716ac-198f-47dc-afc1-98061cef3e3b" released by "delete_volume" :: held 1.481s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Created reservations ['d588f347-5e02-400f-acdd-1e58625af359', '1ee67746-9da6-4ca2-9b1f-3b1e2e181275', '70b246b6-d042-4567-a5f3-3878a9ab6fee', 'be5b7473-b830-4d36-842f-381253fed58c'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:24 devstack sudo[109315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:17:24 devstack sudo[109315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-da84e935-1d6d-452c-99ee-9c9a4aaef874-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Lock "cinder-da84e935-1d6d-452c-99ee-9c9a4aaef874-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-da84e935-1d6d-452c-99ee-9c9a4aaef874" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-da84e935-1d6d-452c-99ee-9c9a4aaef874" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:24 devstack sudo[109315]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.698s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:17:24 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[65285d79-0aef-40fd-ac9b-c386701e0ddc]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4572b091-f0b4-4629-bd75-80ac374cd87a tempest-VolumesGetTest-253327212 None] Lock "cinder-429716ac-198f-47dc-afc1-98061cef3e3b-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:25 devstack sudo[109320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 Jun 29 03:17:25 devstack sudo[109320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:25 devstack sudo[109320]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874" returned: 0 in 0.748s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:25 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874 Jun 29 03:17:25 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:26 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da84e935-1d6d-452c-99ee-9c9a4aaef874" returned: 0 in 0.902s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-da84e935-1d6d-452c-99ee-9c9a4aaef874" released by "delete_volume" :: held 1.720s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Created reservations ['8e81d481-2fc4-4d31-81bb-71fb21615a1c', '07d3286b-966b-4b8a-b7f3-71b0e2c8114d', '40cb220e-f7a7-4f12-afbb-e5d8b8987a8d', '91e5364c-40cb-4ac0-95c6-c3c410470b0e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:26 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:17:26 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-612cbde0-38c7-4447-8598-429c97b8a660-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Lock "cinder-612cbde0-38c7-4447-8598-429c97b8a660-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-612cbde0-38c7-4447-8598-429c97b8a660" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-612cbde0-38c7-4447-8598-429c97b8a660" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb52237-db8a-45c4-9bf6-4d76e2e32e95]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:27 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:27 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:27 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.761s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:17:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:17:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-546a9bb3-bebf-41d7-bb9f-a70e11a8a8eb tempest-VolumesGetTest-253327212 None] Lock "cinder-da84e935-1d6d-452c-99ee-9c9a4aaef874-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:28 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:28 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660 Jun 29 03:17:28 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:28 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-612cbde0-38c7-4447-8598-429c97b8a660" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-612cbde0-38c7-4447-8598-429c97b8a660" released by "delete_volume" :: held 1.605s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:28 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Created reservations ['9106fca8-505a-46ae-90a3-86d7a57c4e5f', 'db607a73-2b46-41e5-ad50-bd39387d2c54', '76e7183b-3116-4c9c-9edc-69c5fc25cd42', 'ad62cf63-e2d0-409a-917b-a258344df4a8'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:29 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:17:29 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:29 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.906s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:17:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:17:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aaa6e8e9-becc-47a5-8ada-01ccf87feaf9 tempest-VolumesGetTest-253327212 None] Lock "cinder-612cbde0-38c7-4447-8598-429c97b8a660-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (d01591a9-eef6-4edb-b4c0-98c2dafcc683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f167435-0b70-4458-8f62-3527b6a5cb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f167435-0b70-4458-8f62-3527b6a5cb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1271218429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267fcb78-e666-4840-82bd-6aec005b685c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:30Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4da6d3-7ac2-49e2-a3ac-424fb5645a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4da6d3-7ac2-49e2-a3ac-424fb5645a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f937cc1-88ef-4ad8-9463-02b8339575cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f937cc1-88ef-4ad8-9463-02b8339575cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '267fcb78-e666-4840-82bd-6aec005b685c', 'volume_name': 'volume-267fcb78-e666-4840-82bd-6aec005b685c', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d34a6b-b477-49bb-838f-366aef3be074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d34a6b-b477-49bb-838f-366aef3be074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a176d6-532d-4ce5-a90e-0efdfcb80ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:30 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Volume 267fcb78-e666-4840-82bd-6aec005b685c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-267fcb78-e666-4840-82bd-6aec005b685c', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 29 03:17:30 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Trying to clone 267fcb78-e666-4840-82bd-6aec005b685c from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:17:31 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:17:31 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Image download 20.69 MB at 20.69 MB/s Jun 29 03:17:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[884c997c-d9da-4208-b464-fcc77a6ad417]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:31 devstack sudo[109736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD Jun 29 03:17:31 devstack sudo[109736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:32 devstack sudo[109736]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD" returned: 0 in 0.826s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:32 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 is fetched for user 92455e2a5c8b468fbe604acaac0329a5. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:17:32 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b602037-e8b5-471d-9e61-21d067a7f77d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:32 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD Jun 29 03:17:32 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:33 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1271218429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267fcb78-e666-4840-82bd-6aec005b685c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:30Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Creating volume 267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:17:33 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:17:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:33 devstack sudo[109748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c 1073741824 Jun 29 03:17:33 devstack sudo[109748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:34 devstack sudo[109748]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c 1073741824" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:34 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:34 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:34 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 0 in 0.625s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Attempting download of ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume 267fcb78-e666-4840-82bd-6aec005b685c. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[03434c6a-29cc-4e4c-a00c-6363402d3d6f]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:34 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p Jun 29 03:17:34 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:35 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p" returned: 0 in 0.719s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:35 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p Jun 29 03:17:35 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:36 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p" returned: 1 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_mul0858p' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab71180-7288-4184-9bdd-99e550cc3d37]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:36 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD Jun 29 03:17:36 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:36 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD" returned: 0 in 0.713s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 was qcow2, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:17:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:36 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:36 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:38 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 0 in 1.766s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:38 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ada45929-2cf6-4ad7-a5a4-d0a8b54685e3_2v7juvksdevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:17:38 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Converted 112.00 MB image at 63.39 MB/s Jun 29 03:17:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:38 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c 1G Jun 29 03:17:38 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:39 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c 1G" returned: 0 in 0.672s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:39 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5d9c2c-06aa-4f4b-b2a5-9a7f6ae861a9]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:39 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:39 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:40 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 0 in 0.768s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:40 devstack sudo[109792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:40 devstack sudo[109792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:40 devstack sudo[109792]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 1 in 0.767s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Downloaded image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}])) to volume 267fcb78-e666-4840-82bd-6aec005b685c successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Temporary image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 for user 92455e2a5c8b468fbe604acaac0329a5 is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Marking volume 267fcb78-e666-4840-82bd-6aec005b685c as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Copying metadata from image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 to 267fcb78-e666-4840-82bd-6aec005b685c. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:17:40 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Creating volume glance metadata for volume 267fcb78-e666-4840-82bd-6aec005b685c backed by image ada45929-2cf6-4ad7-a5a4-d0a8b54685e3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09a176d6-532d-4ce5-a90e-0efdfcb80ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267fcb78-e666-4840-82bd-6aec005b685c', 'volume_size': 1, 'image_id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a288db7ad41f452d95315b81741a6fa5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ada45929-2cf6-4ad7-a5a4-d0a8b54685e3', 'created_at': datetime.datetime(2026, 6, 29, 0, 53, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 0, 53, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ada45929-2cf6-4ad7-a5a4-d0a8b54685e3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51998de6-d7c2-4641-a74f-e8514a9c66c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:41 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Volume volume-267fcb78-e666-4840-82bd-6aec005b685c (267fcb78-e666-4840-82bd-6aec005b685c): created successfully Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51998de6-d7c2-4641-a74f-e8514a9c66c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (d01591a9-eef6-4edb-b4c0-98c2dafcc683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f4b1910e-5d71-4881-8df2-1b72d66bf32e tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (5c396820-1953-4c7a-a6ee-a29436853313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85d3a3f-d311-423d-b7c7-bc766a64d517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85d3a3f-d311-423d-b7c7-bc766a64d517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-906975485',display_name='tempest-VolumesGetTest-Volume-31086208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce843b2-5864-4bca-b768-d8ebf3637b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:42Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431b61b2-69c1-4e2f-a310-f1a9fbcec1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431b61b2-69c1-4e2f-a310-f1a9fbcec1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88dba9ce-6c28-4cfd-803d-8dc447f7c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88dba9ce-6c28-4cfd-803d-8dc447f7c522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce843b2-5864-4bca-b768-d8ebf3637b76', 'volume_name': 'volume-9ce843b2-5864-4bca-b768-d8ebf3637b76', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff67a03-9188-4675-a569-fd5c04c30f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff67a03-9188-4675-a569-fd5c04c30f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c4e504-8237-4516-aa79-985105c4bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Volume 9ce843b2-5864-4bca-b768-d8ebf3637b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce843b2-5864-4bca-b768-d8ebf3637b76', 'volume_size': 1} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:17:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-906975485',display_name='tempest-VolumesGetTest-Volume-31086208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce843b2-5864-4bca-b768-d8ebf3637b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b92419fb99364ad7992472671142f064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:17:42Z,use_quota=True,user_id='92455e2a5c8b468fbe604acaac0329a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Creating volume 9ce843b2-5864-4bca-b768-d8ebf3637b76 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:17:42 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:17:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:42 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 1073741824 Jun 29 03:17:42 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:43 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 1073741824" returned: 0 in 0.963s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:43 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 Jun 29 03:17:43 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:43 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76" returned: 0 in 0.626s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c4e504-8237-4516-aa79-985105c4bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce843b2-5864-4bca-b768-d8ebf3637b76', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3702f76-73bd-4502-95f6-26f0593be958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:17:43 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Volume volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 (9ce843b2-5864-4bca-b768-d8ebf3637b76): created successfully Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3702f76-73bd-4502-95f6-26f0593be958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:17:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Flow 'volume_create_manager' (5c396820-1953-4c7a-a6ee-a29436853313) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:17:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7e4d4c22-7333-43d5-a20d-eb778b1c5855 tempest-VolumesGetTest-253327212 None] Created volume successfully. Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-9ce843b2-5864-4bca-b768-d8ebf3637b76-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Lock "cinder-9ce843b2-5864-4bca-b768-d8ebf3637b76-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-9ce843b2-5864-4bca-b768-d8ebf3637b76" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-9ce843b2-5864-4bca-b768-d8ebf3637b76" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959c17a-042d-4283-8c4f-3574220569c4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:44 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 Jun 29 03:17:44 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:44 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76" returned: 0 in 0.705s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:44 devstack sudo[109951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76 Jun 29 03:17:44 devstack sudo[109951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:45 devstack sudo[109951]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-9ce843b2-5864-4bca-b768-d8ebf3637b76" returned: 0 in 0.609s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-9ce843b2-5864-4bca-b768-d8ebf3637b76" released by "delete_volume" :: held 1.352s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Created reservations ['2b347d01-0be8-4158-a16f-725756cc83e8', '032b6f59-8d26-407c-a52b-7a71cc0198cf', '57031e66-d8c1-41fb-b499-f5a16f3e31a5', 'cb56a0f3-0081-44d2-b35f-28f351c7567a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:45 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:17:45 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:46 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.626s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:17:46 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d9304dd3-df59-4439-843b-f9fe0b8f530c tempest-VolumesGetTest-253327212 None] Lock "cinder-9ce843b2-5864-4bca-b768-d8ebf3637b76-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-267fcb78-e666-4840-82bd-6aec005b685c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Lock "cinder-267fcb78-e666-4840-82bd-6aec005b685c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Acquiring lock "cinder-quobyte-267fcb78-e666-4840-82bd-6aec005b685c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-267fcb78-e666-4840-82bd-6aec005b685c" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[55928e08-9dd1-499d-a286-c405c2c42ffd]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:17:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:46 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:46 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:47 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 0 in 0.706s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:47 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:47 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:48 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 1 in 0.745s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:48 devstack sudo[109967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c Jun 29 03:17:48 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:48 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-267fcb78-e666-4840-82bd-6aec005b685c" returned: 0 in 0.645s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Lock "cinder-quobyte-267fcb78-e666-4840-82bd-6aec005b685c" released by "delete_volume" :: held 2.151s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Created reservations ['8106d753-9028-40ac-991b-2b3d81a4032f', '7f691059-30f4-4ed4-a0aa-afe1fa3e9612', '668a2727-91a2-4efa-82b5-500fea262904', '702910cb-13ce-447f-8b1e-22d576a7b91e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:17:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:17:48 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:17:48 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:17:49 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Jun 29 03:17:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.641s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:17:49 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:17:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Deleted volume successfully. Jun 29 03:17:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-fa81af24-2a02-4719-8577-73471b18f9db tempest-VolumesGetTest-253327212 None] Lock "cinder-267fcb78-e666-4840-82bd-6aec005b685c-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:17:58 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=58,cinder:SELECT=41,cinder:INSERT=22,cinder:DELETE=5 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:17:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-1bc1b111-a310-43ca-8b17-e3ee0456d2f8 req-a952cb94-b4d4-4df2-acbd-d25a3055e8f9 tempest-TestShelveInstance-1448662494 None] Terminate volume connection completed successfully. Jun 29 03:17:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-1bc1b111-a310-43ca-8b17-e3ee0456d2f8 req-a952cb94-b4d4-4df2-acbd-d25a3055e8f9 tempest-TestShelveInstance-1448662494 None] Deleting attachment a92493b9-241f-403b-946c-047f2500b08f. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (ab1c685a-6e90-4dec-8047-9e7f77c77f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521a0ecd-d2aa-4d25-894b-fd250d64fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521a0ecd-d2aa-4d25-894b-fd250d64fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1301723962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97bc3fa-8928-40a8-8b5d-8a55951d1d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:02Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59754b1-b4d2-47f4-8afe-f7a0e4996486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d59754b1-b4d2-47f4-8afe-f7a0e4996486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf303d52-288c-4c33-ba66-7d5acedea7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf303d52-288c-4c33-ba66-7d5acedea7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97bc3fa-8928-40a8-8b5d-8a55951d1d8a', 'volume_name': 'volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068d1e47-7dd0-4efe-8153-64f3dd8deda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068d1e47-7dd0-4efe-8153-64f3dd8deda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b6e294-b26c-49ad-84ea-f5286f53d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Volume e97bc3fa-8928-40a8-8b5d-8a55951d1d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a', 'volume_size': 1} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1301723962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97bc3fa-8928-40a8-8b5d-8a55951d1d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:02Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Creating volume e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:18:02 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:18:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:02 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a 1073741824 Jun 29 03:18:02 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:03 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a 1073741824" returned: 0 in 0.842s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:03 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a Jun 29 03:18:03 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:03 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" returned: 0 in 0.610s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b6e294-b26c-49ad-84ea-f5286f53d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b041486e-3aef-4f08-9823-ad66b6943964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:03 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Volume volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a (e97bc3fa-8928-40a8-8b5d-8a55951d1d8a): created successfully Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b041486e-3aef-4f08-9823-ad66b6943964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:03 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (ab1c685a-6e90-4dec-8047-9e7f77c77f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c90dd6e3-7ef3-4d7a-876f-ca5f66b91e7c tempest-VolumesSnapshotTestJSON-644615432 None] Created volume successfully. Jun 29 03:18:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Creating offline snapshot 18adf3b3-b492-416c-954a-9affdf732e97 of volume e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:18:04 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a8f4ca-d210-4d70-a295-ec0618751866]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:04 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a Jun 29 03:18:04 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:05 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:05 devstack sudo[110052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 1G Jun 29 03:18:05 devstack sudo[110052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:05 devstack sudo[110052]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 1G" returned: 0 in 0.808s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:05 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 Jun 29 03:18:05 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:06 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97" returned: 0 in 0.745s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:06 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 is being set with open permissions: ugo+rw Jun 29 03:18:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:06 devstack sudo[110063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 Jun 29 03:18:06 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:07 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97" returned: 0 in 0.623s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:07 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info Jun 29 03:18:07 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:07 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info" returned: 0 in 0.668s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:07 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info is being set with open permissions: ugo+rw Jun 29 03:18:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:08 devstack sudo[110070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info Jun 29 03:18:08 devstack sudo[110070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:08 devstack sudo[110070]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.info" returned: 0 in 0.728s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.401s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.094s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:08 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48bcdc0-234e-4161-8f14-83198c2a8ae1]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-03202afb-7d14-4170-b76b-8c16c4bb4a02 tempest-VolumesSnapshotTestJSON-644615432 None] Create snapshot completed successfully Jun 29 03:18:08 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:18:08 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:09 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 0.762s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:09 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:18:09 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-18adf3b3-b492-416c-954a-9affdf732e97-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-18adf3b3-b492-416c-954a-9affdf732e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-18adf3b3-b492-416c-954a-9affdf732e97" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-18adf3b3-b492-416c-954a-9affdf732e97" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Deleting offline snapshot 18adf3b3-b492-416c-954a-9affdf732e97 of volume e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] snapshot_file for this snap is: volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aab3bbc-c64e-442e-b812-3a2be027c4bd]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:09 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 Jun 29 03:18:09 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:10 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 1 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.592s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-bae1a04f-f34a-4127-a9d7-929820e7e804', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01cb1d89-27df-48a1-8802-ef6b6fbe67e0', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:18:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-8f5e0a9e-c574-4dd2-8098-272020495218 req-4bcf887b-1930-4824-b6e6-0b2b0c2156d5 tempest-TestShelveInstance-1448662494 None] attachment_update completed successfully. Jun 29 03:18:10 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97" returned: 0 in 0.781s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[28850a2d-dfd5-4d2b-89ef-d7ca9fe2c4c0]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:10 devstack sudo[110089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a Jun 29 03:18:10 devstack sudo[110089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:11 devstack sudo[110089]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" returned: 0 in 0.739s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:11 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 Jun 29 03:18:11 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:12 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97" returned: 0 in 0.714s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:12 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97 Jun 29 03:18:12 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:12 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a.18adf3b3-b492-416c-954a-9affdf732e97" returned: 0 in 0.616s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-18adf3b3-b492-416c-954a-9affdf732e97" released by "_delete_snapshot" :: held 2.977s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" released by "delete_snapshot" :: held 3.000s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['9c89951d-763f-48ca-bd19-9cfb3a93b9df', '1d8e37a4-819a-4065-8570-4396e3ab6ca5', '1540f476-bcb9-4376-b792-9c0423ed399d', '10a035a5-8d22-44fd-b4b0-d11e78ba4bdc'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:18:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Delete snapshot completed successfully. Jun 29 03:18:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-03abda4f-d443-43e3-bd0d-31830a91ceec tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-18adf3b3-b492-416c-954a-9affdf732e97-delete_snapshot" released by "delete_snapshot" :: held 3.202s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (7cce1b40-d6ac-4ba1-ad2b-3e8cddb295e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb023d74-39eb-49bc-90d7-9dc088a03327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb023d74-39eb-49bc-90d7-9dc088a03327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-481423842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2027470-914c-4804-8834-338dcf3a83a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:14Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769e42d4-7a49-4d90-a6ea-f97e9088cd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (769e42d4-7a49-4d90-a6ea-f97e9088cd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518357de-3ef8-444d-b109-0ff2b8b22c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518357de-3ef8-444d-b109-0ff2b8b22c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2027470-914c-4804-8834-338dcf3a83a2', 'volume_name': 'volume-a2027470-914c-4804-8834-338dcf3a83a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c6993b-4352-4e0a-bece-49a3d542364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c6993b-4352-4e0a-bece-49a3d542364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cd77a7-0090-4dd1-b9ac-57e0171ec381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:14 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Volume a2027470-914c-4804-8834-338dcf3a83a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2027470-914c-4804-8834-338dcf3a83a2', 'volume_size': 1} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-481423842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2027470-914c-4804-8834-338dcf3a83a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:14Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Creating volume a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:18:14 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:18:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:14 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 1073741824 Jun 29 03:18:14 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:15 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 1073741824" returned: 0 in 0.855s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:15 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:15 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:16 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.665s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cd77a7-0090-4dd1-b9ac-57e0171ec381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2027470-914c-4804-8834-338dcf3a83a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c44696-36ab-47bf-885c-335a0f1341de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:16 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Volume volume-a2027470-914c-4804-8834-338dcf3a83a2 (a2027470-914c-4804-8834-338dcf3a83a2): created successfully Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c44696-36ab-47bf-885c-335a0f1341de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (7cce1b40-d6ac-4ba1-ad2b-3e8cddb295e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0d5bf17a-3b61-4086-8ced-c60be38be4c0 tempest-VolumesSnapshotTestJSON-644615432 None] Created volume successfully. Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Creating offline snapshot 28d7621d-5eff-4b3c-98b1-016e6c0621f8 of volume a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3c992-5915-4171-8554-ff4e9bc4079e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:16 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:16 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:17 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:17 devstack sudo[110119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:18:17 devstack sudo[110119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.886s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:17 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 1G Jun 29 03:18:17 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:18 devstack sudo[110119]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.717s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:18:18 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 1G" returned: 0 in 0.851s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2027470-914c-4804-8834-338dcf3a83a2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:18 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2027470-914c-4804-8834-338dcf3a83a2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 Jun 29 03:18:18 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:19 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2027470-914c-4804-8834-338dcf3a83a2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8" returned: 0 in 0.733s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:19 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 is being set with open permissions: ugo+rw Jun 29 03:18:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:19 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 Jun 29 03:18:19 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:19 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8" returned: 0 in 0.696s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:19 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=76,cinder:UPDATE=67,cinder:DELETE=5,cinder:INSERT=18 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:18:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:19 devstack sudo[110209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info Jun 29 03:18:19 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:20 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info" returned: 0 in 0.639s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:20 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info is being set with open permissions: ugo+rw Jun 29 03:18:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:20 devstack sudo[110213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info Jun 29 03:18:20 devstack sudo[110213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:21 devstack sudo[110213]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.info" returned: 0 in 0.712s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.608s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9826330b-be72-4d54-a747-c71051790d8d tempest-VolumesSnapshotTestJSON-644615432 None] Create snapshot completed successfully Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (8d3aceb9-5656-489e-aad8-ab4a70c552d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bf3c27-5c7c-4d77-8dc7-7775015b4a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bf3c27-5c7c-4d77-8dc7-7775015b4a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1658333390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91dc035f-2170-4176-8f11-c1603e78793d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=28d7621d-5eff-4b3c-98b1-016e6c0621f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:22Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b485e464-48ca-42e8-a469-fe043a61257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b485e464-48ca-42e8-a469-fe043a61257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aba44a2-43c6-4ce6-acec-3f92941183d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aba44a2-43c6-4ce6-acec-3f92941183d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '91dc035f-2170-4176-8f11-c1603e78793d', 'volume_name': 'volume-91dc035f-2170-4176-8f11-c1603e78793d', 'volume_size': 2, 'snapshot_id': '28d7621d-5eff-4b3c-98b1-016e6c0621f8'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ac403c-e959-4425-85d5-86f8b6523d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ac403c-e959-4425-85d5-86f8b6523d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f272c675-5e04-492d-b02c-6dd626215341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Volume 91dc035f-2170-4176-8f11-c1603e78793d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-91dc035f-2170-4176-8f11-c1603e78793d', 'volume_size': 2, 'snapshot_id': '28d7621d-5eff-4b3c-98b1-016e6c0621f8'} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-28d7621d-5eff-4b3c-98b1-016e6c0621f8-91dc035f-2170-4176-8f11-c1603e78793d" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-28d7621d-5eff-4b3c-98b1-016e6c0621f8-91dc035f-2170-4176-8f11-c1603e78793d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Creating volume 91dc035f-2170-4176-8f11-c1603e78793d from snapshot 28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-91dc035f-2170-4176-8f11-c1603e78793d" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-91dc035f-2170-4176-8f11-c1603e78793d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] snapshot: 28d7621d-5eff-4b3c-98b1-016e6c0621f8, volume: 91dc035f-2170-4176-8f11-c1603e78793d, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207bac4-9b0c-4cee-a932-ba2bbae2e3f8]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:22 devstack sudo[110536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 Jun 29 03:18:22 devstack sudo[110536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:23 devstack sudo[110536]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8" returned: 0 in 0.969s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2027470-914c-4804-8834-338dcf3a83a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:18:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:18:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:18:23 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8459cd6a-09cc-47cb-9428-63d9f7cb394f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:23 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:23 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:24 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.954s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:24 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:18:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:24 devstack sudo[110621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d Jun 29 03:18:24 devstack sudo[110621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:30 devstack sudo[110621]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d" returned: 0 in 5.951s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e927d4c1-bede-463d-9dcb-cdec7ea14e92]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:30 devstack sudo[110637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:30 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:31 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.948s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:31 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:18:31 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Converted 1024.00 MB image at 172.04 MB/s Jun 29 03:18:31 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d is being set with open permissions: ugo+rw Jun 29 03:18:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:31 devstack sudo[110642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d Jun 29 03:18:31 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:32 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d" returned: 0 in 0.644s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-91dc035f-2170-4176-8f11-c1603e78793d" released by "_copy_volume_from_snapshot" :: held 9.569s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-28d7621d-5eff-4b3c-98b1-016e6c0621f8-91dc035f-2170-4176-8f11-c1603e78793d" released by "_create_volume_from_snapshot" :: held 9.600s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.614s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f272c675-5e04-492d-b02c-6dd626215341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91dc035f-2170-4176-8f11-c1603e78793d', 'volume_size': 2, 'snapshot_id': '28d7621d-5eff-4b3c-98b1-016e6c0621f8'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4708fac-fb99-4833-84ea-1d0b2a41196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:32 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Volume volume-91dc035f-2170-4176-8f11-c1603e78793d (91dc035f-2170-4176-8f11-c1603e78793d): created successfully Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4708fac-fb99-4833-84ea-1d0b2a41196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (8d3aceb9-5656-489e-aad8-ab4a70c552d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7d0cced6-fb6b-4692-bea2-a6e1ce35add9 tempest-VolumesSnapshotTestJSON-644615432 None] Created volume successfully. Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-91dc035f-2170-4176-8f11-c1603e78793d-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-91dc035f-2170-4176-8f11-c1603e78793d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-91dc035f-2170-4176-8f11-c1603e78793d" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-91dc035f-2170-4176-8f11-c1603e78793d" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3d387-2cbf-43df-9751-6a54b238a24c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:32 devstack sudo[110645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d Jun 29 03:18:32 devstack sudo[110645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:33 devstack sudo[110645]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:33 devstack sudo[110650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d Jun 29 03:18:33 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:34 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-91dc035f-2170-4176-8f11-c1603e78793d" returned: 0 in 0.616s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-91dc035f-2170-4176-8f11-c1603e78793d" released by "delete_volume" :: held 1.412s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['3ba83b00-b551-470a-ad88-2ee802d77c9e', 'c1f4a0a6-5d44-4535-b074-1ea6bd7cef97', '0752bc5a-2554-43e9-818e-0185a295c1e4', '2bcd12df-7da0-4eae-8814-2af0778509b6'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:34 devstack sudo[110653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:18:34 devstack sudo[110653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:34 devstack sudo[110653]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.642s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:34 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:18:34 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Deleted volume successfully. Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f41a1262-a19b-4776-99f1-3749a193db2c tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-91dc035f-2170-4176-8f11-c1603e78793d-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-28d7621d-5eff-4b3c-98b1-016e6c0621f8-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-28d7621d-5eff-4b3c-98b1-016e6c0621f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-a2027470-914c-4804-8834-338dcf3a83a2" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-a2027470-914c-4804-8834-338dcf3a83a2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-28d7621d-5eff-4b3c-98b1-016e6c0621f8" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-28d7621d-5eff-4b3c-98b1-016e6c0621f8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Deleting offline snapshot 28d7621d-5eff-4b3c-98b1-016e6c0621f8 of volume a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] snapshot_file for this snap is: volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0c5774-0580-4ee6-a536-5a92cdad3b57]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:35 devstack sudo[110656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 Jun 29 03:18:35 devstack sudo[110656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:35 devstack sudo[110656]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8" returned: 0 in 0.771s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2027470-914c-4804-8834-338dcf3a83a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed5a1f-ddc8-47df-9ef0-b0216809ae3e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:36 devstack sudo[110661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:36 devstack sudo[110661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:36 devstack sudo[110661]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:36 devstack sudo[110666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 Jun 29 03:18:36 devstack sudo[110666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:37 devstack sudo[110666]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8" returned: 0 in 0.724s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:37 devstack sudo[110672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8 Jun 29 03:18:37 devstack sudo[110672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:37 devstack sudo[110672]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2.28d7621d-5eff-4b3c-98b1-016e6c0621f8" returned: 0 in 0.619s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-28d7621d-5eff-4b3c-98b1-016e6c0621f8" released by "_delete_snapshot" :: held 2.953s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-a2027470-914c-4804-8834-338dcf3a83a2" released by "delete_snapshot" :: held 2.974s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['2c97f1a6-b60a-46df-9d21-a6efde8a06ea', 'a565c179-7767-468c-afa4-13375ef905f1', 'd9720f27-8207-436d-8ec3-cce71b569f1a', '1a2c3017-5608-4cb1-8554-5a2e10bca024'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:18:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Delete snapshot completed successfully. Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-5b8d7591-a336-43d8-8f38-ab59832567a7 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-28d7621d-5eff-4b3c-98b1-016e6c0621f8-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-a2027470-914c-4804-8834-338dcf3a83a2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-a2027470-914c-4804-8834-338dcf3a83a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-a2027470-914c-4804-8834-338dcf3a83a2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-a2027470-914c-4804-8834-338dcf3a83a2" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdbffe5-d2a9-4696-baf2-df3b83a97a5b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:38 devstack sudo[110675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:38 devstack sudo[110675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:39 devstack sudo[110675]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.752s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:39 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2 Jun 29 03:18:39 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:39 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2027470-914c-4804-8834-338dcf3a83a2" returned: 0 in 0.650s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-a2027470-914c-4804-8834-338dcf3a83a2" released by "delete_volume" :: held 1.462s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['a8d22742-5d0d-4dc4-977f-d136bcf78ebf', '70485a36-31c9-474c-864b-3774fc2ba3b4', '3fbe5ee4-434d-4e33-9a88-79f98be2fb55', 'b893079e-8fb5-4f0b-b960-b1e0d5da36f8'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:40 devstack sudo[110708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:18:40 devstack sudo[110708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:40 devstack sudo[110708]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.646s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:40 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:18:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Deleted volume successfully. Jun 29 03:18:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-725714d0-e6b5-45a7-8231-cad990e0db98 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-a2027470-914c-4804-8834-338dcf3a83a2-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (bafef783-96ee-403b-8a95-d74702b28d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2d5b2a-dd0c-47df-8ff5-59999365d7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d2d5b2a-dd0c-47df-8ff5-59999365d7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1401107197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106affd9-e975-4e67-bc7d-149f016876de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:41Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c00dcf-cebe-4039-ac8b-cf184c9f34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24c00dcf-cebe-4039-ac8b-cf184c9f34dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb47af4a-b400-469c-a706-0ec3e29a7860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb47af4a-b400-469c-a706-0ec3e29a7860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106affd9-e975-4e67-bc7d-149f016876de', 'volume_name': 'volume-106affd9-e975-4e67-bc7d-149f016876de', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52bde3c-099e-4b66-85db-9882e120722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52bde3c-099e-4b66-85db-9882e120722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55478a56-5552-477d-95f5-17e2cf6b85ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:41 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Volume 106affd9-e975-4e67-bc7d-149f016876de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106affd9-e975-4e67-bc7d-149f016876de', 'volume_size': 1} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1401107197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106affd9-e975-4e67-bc7d-149f016876de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:41Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Creating volume 106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:18:41 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:18:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:41 devstack sudo[110750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de 1073741824 Jun 29 03:18:41 devstack sudo[110750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:42 devstack sudo[110750]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de 1073741824" returned: 0 in 0.825s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:42 devstack sudo[110758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:18:42 devstack sudo[110758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:42 devstack sudo[110758]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.605s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55478a56-5552-477d-95f5-17e2cf6b85ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106affd9-e975-4e67-bc7d-149f016876de', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1998a4a9-6a4e-47af-8f12-617a120fc8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Volume volume-106affd9-e975-4e67-bc7d-149f016876de (106affd9-e975-4e67-bc7d-149f016876de): created successfully Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1998a4a9-6a4e-47af-8f12-617a120fc8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (bafef783-96ee-403b-8a95-d74702b28d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5c3fc0db-e505-40fc-a360-f097124bac30 tempest-VolumesSnapshotTestJSON-644615432 None] Created volume successfully. Jun 29 03:18:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Creating offline snapshot b5909ce0-c1c4-4899-8e4d-83dba09e6803 of volume 106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:18:43 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e61ce4d-32b7-4c13-b3ae-b5fa52b41067]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:43 devstack sudo[110761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:18:43 devstack sudo[110761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:44 devstack sudo[110761]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.714s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:44 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 1G Jun 29 03:18:44 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:44 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 1G" returned: 0 in 0.749s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106affd9-e975-4e67-bc7d-149f016876de -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:44 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106affd9-e975-4e67-bc7d-149f016876de -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 Jun 29 03:18:44 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:45 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-106affd9-e975-4e67-bc7d-149f016876de -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803" returned: 0 in 0.670s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:45 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 is being set with open permissions: ugo+rw Jun 29 03:18:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:45 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 Jun 29 03:18:45 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:46 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803" returned: 0 in 0.610s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:46 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info Jun 29 03:18:46 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:46 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info" returned: 0 in 0.627s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:46 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info is being set with open permissions: ugo+rw Jun 29 03:18:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:46 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info Jun 29 03:18:46 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:47 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.info" returned: 0 in 0.663s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.123s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2bc0e8a7-b79c-4b0d-b912-15c605d92ffe tempest-VolumesSnapshotTestJSON-644615432 None] Create snapshot completed successfully Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (2d5fb6c3-ff0c-436a-b5d5-4aeaecdaafd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2f66c8-0176-4ee6-b5c2-2e11ed1362d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac2f66c8-0176-4ee6-b5c2-2e11ed1362d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1044059142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7078fa7-e26a-41f5-a533-2974f6f46551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4f2506d2dcd4f87ac6a7a6b14ebc374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b5909ce0-c1c4-4899-8e4d-83dba09e6803,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:18:49Z,use_quota=True,user_id='ed40a96152ba43d0b48e44066f088fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9502db5-ac6a-4861-b90b-5519b6634fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9502db5-ac6a-4861-b90b-5519b6634fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f491fed-47a7-4774-96d8-8d1dadcf7ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f491fed-47a7-4774-96d8-8d1dadcf7ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c7078fa7-e26a-41f5-a533-2974f6f46551', 'volume_name': 'volume-c7078fa7-e26a-41f5-a533-2974f6f46551', 'volume_size': 1, 'snapshot_id': 'b5909ce0-c1c4-4899-8e4d-83dba09e6803'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107f651c-3cf4-477a-86f5-507caa317715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107f651c-3cf4-477a-86f5-507caa317715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8023499-daac-4320-9043-8d748b4cc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Volume c7078fa7-e26a-41f5-a533-2974f6f46551: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c7078fa7-e26a-41f5-a533-2974f6f46551', 'volume_size': 1, 'snapshot_id': 'b5909ce0-c1c4-4899-8e4d-83dba09e6803'} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-b5909ce0-c1c4-4899-8e4d-83dba09e6803-c7078fa7-e26a-41f5-a533-2974f6f46551" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-b5909ce0-c1c4-4899-8e4d-83dba09e6803-c7078fa7-e26a-41f5-a533-2974f6f46551" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Creating volume c7078fa7-e26a-41f5-a533-2974f6f46551 from snapshot b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-c7078fa7-e26a-41f5-a533-2974f6f46551" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-c7078fa7-e26a-41f5-a533-2974f6f46551" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] snapshot: b5909ce0-c1c4-4899-8e4d-83dba09e6803, volume: c7078fa7-e26a-41f5-a533-2974f6f46551, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[85333e07-447d-49da-8c5c-19fdfc933438]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:49 devstack sudo[110787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 Jun 29 03:18:49 devstack sudo[110787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:49 devstack sudo[110787]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106affd9-e975-4e67-bc7d-149f016876de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f53660-9fd4-4732-9790-ad44e23cd3d4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:50 devstack sudo[110792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:18:50 devstack sudo[110792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:50 devstack sudo[110792]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:50 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:18:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:50 devstack sudo[110797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 Jun 29 03:18:50 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:54 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551" returned: 0 in 4.286s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:54 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b70ef0c-32e8-4739-9652-38891f561347]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:55 devstack sudo[110811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:18:55 devstack sudo[110811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:55 devstack sudo[110811]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.880s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:55 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:18:55 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Converted 1024.00 MB image at 238.85 MB/s Jun 29 03:18:55 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 is being set with open permissions: ugo+rw Jun 29 03:18:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:55 devstack sudo[110816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 Jun 29 03:18:55 devstack sudo[110816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:56 devstack sudo[110816]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551" returned: 0 in 0.662s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-c7078fa7-e26a-41f5-a533-2974f6f46551" released by "_copy_volume_from_snapshot" :: held 7.382s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-b5909ce0-c1c4-4899-8e4d-83dba09e6803-c7078fa7-e26a-41f5-a533-2974f6f46551" released by "_create_volume_from_snapshot" :: held 7.410s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.425s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8023499-daac-4320-9043-8d748b4cc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7078fa7-e26a-41f5-a533-2974f6f46551', 'volume_size': 1, 'snapshot_id': 'b5909ce0-c1c4-4899-8e4d-83dba09e6803'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec080776-68fe-44ad-911d-ec663ce5668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:18:56 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Volume volume-c7078fa7-e26a-41f5-a533-2974f6f46551 (c7078fa7-e26a-41f5-a533-2974f6f46551): created successfully Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec080776-68fe-44ad-911d-ec663ce5668e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:18:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Flow 'volume_create_manager' (2d5fb6c3-ff0c-436a-b5d5-4aeaecdaafd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:18:56 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-043ba5ad-8d33-4565-be29-239edaee23bc tempest-VolumesSnapshotTestJSON-644615432 None] Created volume successfully. Jun 29 03:18:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-c7078fa7-e26a-41f5-a533-2974f6f46551-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-c7078fa7-e26a-41f5-a533-2974f6f46551-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-c7078fa7-e26a-41f5-a533-2974f6f46551" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:57 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-c7078fa7-e26a-41f5-a533-2974f6f46551" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:57 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c241d2b-8627-47fb-bf9c-a0de66bb5c45]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:18:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:57 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 Jun 29 03:18:57 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:58 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551" returned: 0 in 0.741s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:58 devstack sudo[110825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551 Jun 29 03:18:58 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:59 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c7078fa7-e26a-41f5-a533-2974f6f46551" returned: 0 in 0.642s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-c7078fa7-e26a-41f5-a533-2974f6f46551" released by "delete_volume" :: held 1.420s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=54,cinder:UPDATE=51,cinder:DELETE=6,cinder:INSERT=13 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['9e5bde8d-04aa-4ec1-85eb-c22e6b628253', '95370ef1-35e9-4592-9fca-051abdcf3779', '1fc54518-13ae-4c4c-9440-dd01a6cb9ec1', '1aaa20fc-9ab6-4e82-b48c-e0985d33e8cf'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:18:59 devstack sudo[110828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:18:59 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:18:59 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.605s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:18:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Deleted volume successfully. Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7c39c6a9-a481-4ecf-9e48-cfcccd2498d2 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-c7078fa7-e26a-41f5-a533-2974f6f46551-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-b5909ce0-c1c4-4899-8e4d-83dba09e6803-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-b5909ce0-c1c4-4899-8e4d-83dba09e6803-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:18:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-106affd9-e975-4e67-bc7d-149f016876de" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-106affd9-e975-4e67-bc7d-149f016876de" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-b5909ce0-c1c4-4899-8e4d-83dba09e6803" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-b5909ce0-c1c4-4899-8e4d-83dba09e6803" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Deleting offline snapshot b5909ce0-c1c4-4899-8e4d-83dba09e6803 of volume 106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] snapshot_file for this snap is: volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c0de38-adde-46d0-915a-885c7d80389e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:00 devstack sudo[110831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 Jun 29 03:19:00 devstack sudo[110831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:00 devstack sudo[110831]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803" returned: 0 in 0.729s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-106affd9-e975-4e67-bc7d-149f016876de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2459e-93da-46ee-80fd-34baa257eb19]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:00 devstack sudo[110836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:19:00 devstack sudo[110836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:01 devstack sudo[110836]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.738s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:01 devstack sudo[110841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 Jun 29 03:19:01 devstack sudo[110841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:02 devstack sudo[110841]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803" returned: 0 in 0.748s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:02 devstack sudo[110851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803 Jun 29 03:19:02 devstack sudo[110851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:02 devstack sudo[110851]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de.b5909ce0-c1c4-4899-8e4d-83dba09e6803" returned: 0 in 0.691s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-b5909ce0-c1c4-4899-8e4d-83dba09e6803" released by "_delete_snapshot" :: held 2.997s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-106affd9-e975-4e67-bc7d-149f016876de" released by "delete_snapshot" :: held 3.019s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:03 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['26514ac8-aa07-491a-af40-5872df76c12a', '9531f56a-8f86-4288-a058-08127a5fcce9', '8a73bf0f-eae0-495e-a5f0-4d74ea9bf0fa', 'c3f740ac-0976-466f-9ad4-c0fd9719448e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:03 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Delete snapshot completed successfully. Jun 29 03:19:03 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-267578ef-7f38-4a2e-b97b-ef71e9a115b0 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-b5909ce0-c1c4-4899-8e4d-83dba09e6803-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-106affd9-e975-4e67-bc7d-149f016876de-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-106affd9-e975-4e67-bc7d-149f016876de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-106affd9-e975-4e67-bc7d-149f016876de" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-106affd9-e975-4e67-bc7d-149f016876de" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:04 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a661a77-3584-452f-aa0b-ac9ae6cbcbde]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:04 devstack sudo[110893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:19:04 devstack sudo[110893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:05 devstack sudo[110893]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.767s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:05 devstack sudo[110900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de Jun 29 03:19:05 devstack sudo[110900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:05 devstack sudo[110900]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-106affd9-e975-4e67-bc7d-149f016876de" returned: 0 in 0.705s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:05 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-106affd9-e975-4e67-bc7d-149f016876de" released by "delete_volume" :: held 1.552s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['cf816db5-d75f-47cd-b387-d6eeacd814c7', '91009bd4-ac81-40fb-8abf-d1f640b2875e', '231e281d-775a-4c60-8347-b6b4513bdf18', '20b02db9-e3fe-4ba4-bdac-2db618b2c4df'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:06 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:06 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "cinder-quobyte-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" acquired by "delete_volume" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:06 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.657s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:06 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Deleted volume successfully. Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1892d47a-0aa5-4fbe-a080-556fdf411f37]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d7b2c195-8fcd-44cf-b66e-a7e12bff70e6 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-106affd9-e975-4e67-bc7d-149f016876de-delete_volume" released by "delete_volume" :: held 2.431s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:06 devstack sudo[110909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a Jun 29 03:19:06 devstack sudo[110909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:06 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-01694979-29cf-4625-bbc5-cb13274027c3 req-be5aa287-4933-47cf-8180-876b0fb18dcb tempest-TestShelveInstance-1448662494 None] Terminate volume connection completed successfully. Jun 29 03:19:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-01694979-29cf-4625-bbc5-cb13274027c3 req-be5aa287-4933-47cf-8180-876b0fb18dcb tempest-TestShelveInstance-1448662494 None] Deleting attachment 01cb1d89-27df-48a1-8802-ef6b6fbe67e0. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:19:07 devstack sudo[110909]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" returned: 0 in 0.737s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:07 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a Jun 29 03:19:07 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Acquiring lock "cinder-bae1a04f-f34a-4127-a9d7-929820e7e804-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Lock "cinder-bae1a04f-f34a-4127-a9d7-929820e7e804-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Acquiring lock "cinder-quobyte-bae1a04f-f34a-4127-a9d7-929820e7e804" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Lock "cinder-quobyte-bae1a04f-f34a-4127-a9d7-929820e7e804" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b61a4f-6a38-42f1-ba33-7e90f742a52a]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:07 devstack sudo[110917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:19:07 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:08 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" returned: 0 in 0.659s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-quobyte-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a" released by "delete_volume" :: held 1.471s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Created reservations ['e38d74ad-f672-4aed-8731-5d0113b19c09', '31e96842-ebbf-4b02-ae3c-7389321130de', '122dda1f-3e19-4cb3-b8e9-0815b0b107d9', 'f5727adc-e2a5-4355-bc26-d9ad1a57ba92'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:08 devstack sudo[110920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:08 devstack sudo[110920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:08 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 0.765s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:08 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:19:08 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:08 devstack sudo[110920]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.656s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:09 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Deleted volume successfully. Jun 29 03:19:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8d4bd092-e64e-4c75-9fef-3e0193628d94 tempest-VolumesSnapshotTestJSON-644615432 None] Lock "cinder-e97bc3fa-8928-40a8-8b5d-8a55951d1d8a-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:09 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 1 in 0.790s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:19:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:09 devstack sudo[110930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804 Jun 29 03:19:09 devstack sudo[110930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:10 devstack sudo[110930]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bae1a04f-f34a-4127-a9d7-929820e7e804" returned: 0 in 0.707s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Lock "cinder-quobyte-bae1a04f-f34a-4127-a9d7-929820e7e804" released by "delete_volume" :: held 2.343s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG cinder.quota [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Created reservations ['d49b704e-470a-4130-94f8-6a15bfd81609', '595e3d8d-7261-4e41-820f-cc00f3982563', '8fe413de-8d95-4dd1-9414-06d39b34876a', 'b6eb7995-3e00-4251-8e6a-3f9569593728'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:10 devstack sudo[110933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:10 devstack sudo[110933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:10 devstack sudo[110933]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.733s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG cinder.manager [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Deleted volume successfully. Jun 29 03:19:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [req-01694979-29cf-4625-bbc5-cb13274027c3 req-5b111e0e-70ac-4680-8677-defa9e8b50a4 tempest-TestShelveInstance-1448662494 None] Lock "cinder-bae1a04f-f34a-4127-a9d7-929820e7e804-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Flow 'volume_create_manager' (fabd0c86-69a4-4a7d-a365-ae3c5968d58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69556714-aeac-49cd-81c4-a9be4306fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69556714-aeac-49cd-81c4-a9be4306fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-390865815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54075030-9cdc-4f64-960d-ab8fe29f56f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888a8cf7f0c14774a792723f8e4ebab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:15Z,use_quota=True,user_id='f92fab2f892a4e62b792bcb282660114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e41e25a-5c6f-43c5-92a2-bb1c7439ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e41e25a-5c6f-43c5-92a2-bb1c7439ea74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b19ba9c-591a-4346-af50-47b9eb005af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b19ba9c-591a-4346-af50-47b9eb005af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54075030-9cdc-4f64-960d-ab8fe29f56f2', 'volume_name': 'volume-54075030-9cdc-4f64-960d-ab8fe29f56f2', 'volume_size': 2}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16c969b-8deb-494b-bd8d-569e6b0d4ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e16c969b-8deb-494b-bd8d-569e6b0d4ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9981e0a-1b10-4261-94d8-7a556dc4db78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:15 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Volume 54075030-9cdc-4f64-960d-ab8fe29f56f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54075030-9cdc-4f64-960d-ab8fe29f56f2', 'volume_size': 2} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-390865815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54075030-9cdc-4f64-960d-ab8fe29f56f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='888a8cf7f0c14774a792723f8e4ebab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:15Z,use_quota=True,user_id='f92fab2f892a4e62b792bcb282660114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Creating volume 54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:15 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 2147483648 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:15 devstack sudo[110942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 2147483648 Jun 29 03:19:15 devstack sudo[110942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:16 devstack sudo[110942]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 2147483648" returned: 0 in 0.954s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:16 devstack sudo[110948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 Jun 29 03:19:16 devstack sudo[110948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:17 devstack sudo[110948]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2" returned: 0 in 0.741s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9981e0a-1b10-4261-94d8-7a556dc4db78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54075030-9cdc-4f64-960d-ab8fe29f56f2', 'volume_size': 2}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1ef2ed-ccb9-4e35-b4f4-9672b4e0827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Volume volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 (54075030-9cdc-4f64-960d-ab8fe29f56f2): created successfully Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1ef2ed-ccb9-4e35-b4f4-9672b4e0827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Flow 'volume_create_manager' (fabd0c86-69a4-4a7d-a365-ae3c5968d58a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9f2fe610-1ba3-4cd0-abed-26a5606187c7 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Created volume successfully. Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Creating offline snapshot 971cc0f5-b310-4867-9537-3b579bbba0c1 of volume 54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b0a6a-f6c9-4ab4-9cb2-aae768644e1b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:17 devstack sudo[110953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:17 devstack sudo[110953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:17 devstack sudo[110954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 Jun 29 03:19:17 devstack sudo[110954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:18 devstack sudo[110953]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.719s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:19:18 devstack sudo[110954]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2" returned: 0 in 0.876s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 2G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:18 devstack sudo[110961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 2G Jun 29 03:19:18 devstack sudo[110961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:19 devstack sudo[110961]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 2G" returned: 0 in 0.821s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:19 devstack sudo[110968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 Jun 29 03:19:19 devstack sudo[110968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:20 devstack sudo[110968]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1" returned: 0 in 0.735s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:20 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 is being set with open permissions: ugo+rw Jun 29 03:19:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:20 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 Jun 29 03:19:20 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:20 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:20 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=14 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:19:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:20 devstack sudo[110983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info Jun 29 03:19:20 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:21 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info" returned: 0 in 0.645s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:21 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info is being set with open permissions: ugo+rw Jun 29 03:19:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:21 devstack sudo[110986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info Jun 29 03:19:21 devstack sudo[110986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:22 devstack sudo[110986]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.info" returned: 0 in 0.644s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.506s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cae9553a-5e4f-4da5-bda9-af9affcbd940 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Create snapshot completed successfully Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (cce18bb4-00e6-4a08-a34f-4f059e5be3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04743b3e-116c-4e9f-8c99-86a4b751718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04743b3e-116c-4e9f-8c99-86a4b751718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192496983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d5682-0649-4011-aeb8-16be3ebca621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:22Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c29b8a7-49b5-494c-8cd3-3d545313516f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c29b8a7-49b5-494c-8cd3-3d545313516f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963e2d29-7879-4f59-9d39-8b64e751b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (963e2d29-7879-4f59-9d39-8b64e751b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83d5682-0649-4011-aeb8-16be3ebca621', 'volume_name': 'volume-b83d5682-0649-4011-aeb8-16be3ebca621', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cb05bf-c848-4053-be4d-fefde384ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95cb05bf-c848-4053-be4d-fefde384ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c7cdad-d323-46be-935d-94925636dda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume b83d5682-0649-4011-aeb8-16be3ebca621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83d5682-0649-4011-aeb8-16be3ebca621', 'volume_size': 1} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192496983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b83d5682-0649-4011-aeb8-16be3ebca621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:22Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Creating volume b83d5682-0649-4011-aeb8-16be3ebca621 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:22 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:22 devstack sudo[110989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 1073741824 Jun 29 03:19:22 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "cinder-971cc0f5-b310-4867-9537-3b579bbba0c1-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-971cc0f5-b310-4867-9537-3b579bbba0c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "cinder-quobyte-54075030-9cdc-4f64-960d-ab8fe29f56f2" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-quobyte-54075030-9cdc-4f64-960d-ab8fe29f56f2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "cinder-quobyte-971cc0f5-b310-4867-9537-3b579bbba0c1" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-quobyte-971cc0f5-b310-4867-9537-3b579bbba0c1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Deleting offline snapshot 971cc0f5-b310-4867-9537-3b579bbba0c1 of volume 54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] snapshot_file for this snap is: volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a43e66-0edc-437a-aa10-7c74717ff9c2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:23 devstack sudo[110995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 Jun 29 03:19:23 devstack sudo[110995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:23 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 1073741824" returned: 0 in 0.847s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:23 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 Jun 29 03:19:23 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:23 devstack sudo[110995]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:23 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1" returned: 0 in 0.790s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54075030-9cdc-4f64-960d-ab8fe29f56f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621" returned: 0 in 0.628s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ef080a-9bb8-4ca7-b7ec-c14b2bb62602]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c7cdad-d323-46be-935d-94925636dda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83d5682-0649-4011-aeb8-16be3ebca621', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086b53f2-f483-4917-b682-49aaf77824ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:23 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume volume-b83d5682-0649-4011-aeb8-16be3ebca621 (b83d5682-0649-4011-aeb8-16be3ebca621): created successfully Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (086b53f2-f483-4917-b682-49aaf77824ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:23 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (cce18bb4-00e6-4a08-a34f-4f059e5be3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:23 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5965b03e-fdb1-4dcb-8877-7e7e020cf055 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created volume successfully. Jun 29 03:19:23 devstack sudo[111006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 Jun 29 03:19:23 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:24 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2" returned: 0 in 0.745s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:24 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 Jun 29 03:19:24 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (f88e9d2c-045a-4cf4-90c0-24a0b4353ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a15411-1ec4-4968-a8e3-04f98ccb245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a15411-1ec4-4968-a8e3-04f98ccb245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974046557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5e8580-25b2-42bb-b098-e21dd68c18b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:25Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7b7d04-9fb1-4a0f-b0b3-bc7bacdac427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7b7d04-9fb1-4a0f-b0b3-bc7bacdac427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24c79f9-def6-47ac-8fc7-9df66aad6ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24c79f9-def6-47ac-8fc7-9df66aad6ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5e8580-25b2-42bb-b098-e21dd68c18b5', 'volume_name': 'volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5338643b-5254-4678-96f2-b1dcb8740738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5338643b-5254-4678-96f2-b1dcb8740738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec5f7fb-5f9e-44ee-8f26-14f95d9bae89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:24 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume bb5e8580-25b2-42bb-b098-e21dd68c18b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5', 'volume_size': 1} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974046557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5e8580-25b2-42bb-b098-e21dd68c18b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:25Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Creating volume bb5e8580-25b2-42bb-b098-e21dd68c18b5 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:24 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:24 devstack sudo[111013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 1073741824 Jun 29 03:19:24 devstack sudo[111013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (bf4aa612-600c-4b2d-a651-4a464ecb21b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633d653a-4ac8-4619-b856-1c6fe99277a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (633d653a-4ac8-4619-b856-1c6fe99277a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131253537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891b9918-e1ef-4103-91e3-5ada041b39c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:25Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb49184-ea4a-47f3-9ee9-889c7bac71ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb49184-ea4a-47f3-9ee9-889c7bac71ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1092daec-3b65-435a-873b-46d8e53c58cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1092daec-3b65-435a-873b-46d8e53c58cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891b9918-e1ef-4103-91e3-5ada041b39c4', 'volume_name': 'volume-891b9918-e1ef-4103-91e3-5ada041b39c4', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7a1b3c-e86d-411e-bafc-fbf8b6f764ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c7a1b3c-e86d-411e-bafc-fbf8b6f764ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde31c17-2a8e-44d3-8ff3-ca60395dc330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume 891b9918-e1ef-4103-91e3-5ada041b39c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891b9918-e1ef-4103-91e3-5ada041b39c4', 'volume_size': 1} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (ec15e255-d42e-4086-b019-5898a4352a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f052997-caee-47f4-8c53-33ea8474c59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1" returned: 0 in 0.932s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:25 devstack sudo[111019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1 Jun 29 03:19:25 devstack sudo[111019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f052997-caee-47f4-8c53-33ea8474c59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1141062746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0d31dc-4419-42ea-b7d0-81929129fb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:25Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4568a9-153b-420f-904c-9353166273f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb4568a9-153b-420f-904c-9353166273f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2704d64f-9245-48a9-82f7-a22ce70a8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2704d64f-9245-48a9-82f7-a22ce70a8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a0d31dc-4419-42ea-b7d0-81929129fb33', 'volume_name': 'volume-7a0d31dc-4419-42ea-b7d0-81929129fb33', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5192a217-0e06-4594-ac68-0d12887937e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5192a217-0e06-4594-ac68-0d12887937e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79d8284-d85b-47ee-b2de-1cd0b4c28d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume 7a0d31dc-4419-42ea-b7d0-81929129fb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a0d31dc-4419-42ea-b7d0-81929129fb33', 'volume_size': 1} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:25 devstack sudo[111013]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 1073741824" returned: 0 in 1.004s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (64759ac9-046b-4ec9-9e15-4ffcb463f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec44e11-3af2-4dec-92ac-ed4d30ac9d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec44e11-3af2-4dec-92ac-ed4d30ac9d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-995914345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2eeae8c-1872-484c-a429-11728013ba5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:26Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a608be-e7a3-4172-b617-5648d455d063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90a608be-e7a3-4172-b617-5648d455d063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e58e8-9486-4c30-aa6f-1905cd1b030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e58e8-9486-4c30-aa6f-1905cd1b030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2eeae8c-1872-484c-a429-11728013ba5b', 'volume_name': 'volume-a2eeae8c-1872-484c-a429-11728013ba5b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e585a81-14b9-476c-83e6-b80b31d07623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e585a81-14b9-476c-83e6-b80b31d07623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f208b528-5f90-43c9-8749-500feef7374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume a2eeae8c-1872-484c-a429-11728013ba5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2eeae8c-1872-484c-a429-11728013ba5b', 'volume_size': 1} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:25 devstack sudo[111025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 Jun 29 03:19:25 devstack sudo[111025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:26 devstack sudo[111019]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (92cf6e30-a31f-4b91-9675-cb63f2362a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12264f7-8208-4de4-a2e9-b5670ff0807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2.971cc0f5-b310-4867-9537-3b579bbba0c1" returned: 0 in 0.779s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12264f7-8208-4de4-a2e9-b5670ff0807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-452284161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1807ed9-19e5-40d8-a30d-101f2f211d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:26Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17a8997-8eaa-45d3-b22b-09b649240083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17a8997-8eaa-45d3-b22b-09b649240083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6f88f0-f97e-4522-80d1-cc12b26298be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6f88f0-f97e-4522-80d1-cc12b26298be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1807ed9-19e5-40d8-a30d-101f2f211d9b', 'volume_name': 'volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aed85b-a699-4717-a3c0-a14a89aaf2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aed85b-a699-4717-a3c0-a14a89aaf2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4be57e-65c3-4e5b-bfec-0459163550f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:26 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume b1807ed9-19e5-40d8-a30d-101f2f211d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b', 'volume_size': 1} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-quobyte-971cc0f5-b310-4867-9537-3b579bbba0c1" released by "_delete_snapshot" :: held 3.390s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-quobyte-54075030-9cdc-4f64-960d-ab8fe29f56f2" released by "delete_snapshot" :: held 3.412s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Created reservations ['96db52d3-a52e-4f02-bfe9-1de99485749c', '30fd386e-d6a3-49bd-b9f7-8ebab445dc5a', '74fa496d-f8cd-4909-99e5-8bd74c526cb7', '11146646-60bc-4805-bcbc-59b39f0b2ed1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Delete snapshot completed successfully. Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-631bfcaf-600c-456c-91f1-f2e95a9cce6c tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-971cc0f5-b310-4867-9537-3b579bbba0c1-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:26 devstack sudo[111025]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.453s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131253537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891b9918-e1ef-4103-91e3-5ada041b39c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:25Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Creating volume 891b9918-e1ef-4103-91e3-5ada041b39c4 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:26 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:26 devstack sudo[111029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 1073741824 Jun 29 03:19:26 devstack sudo[111029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ec5f7fb-5f9e-44ee-8f26-14f95d9bae89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4044c016-b40a-43c3-add3-ebd52d984264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:26 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 (bb5e8580-25b2-42bb-b098-e21dd68c18b5): created successfully Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4044c016-b40a-43c3-add3-ebd52d984264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (f88e9d2c-045a-4cf4-90c0-24a0b4353ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-40e7234b-869e-48c3-8fa7-8317d29b874e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created volume successfully. Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "cinder-54075030-9cdc-4f64-960d-ab8fe29f56f2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-54075030-9cdc-4f64-960d-ab8fe29f56f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "cinder-quobyte-54075030-9cdc-4f64-960d-ab8fe29f56f2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-quobyte-54075030-9cdc-4f64-960d-ab8fe29f56f2" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8e5931-1b06-4f4e-914d-d617028318d3]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:27 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 Jun 29 03:19:27 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:27 devstack sudo[111029]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 1073741824" returned: 0 in 0.875s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:27 devstack sudo[111038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 Jun 29 03:19:27 devstack sudo[111038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:28 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2" returned: 0 in 0.795s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:28 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2 Jun 29 03:19:28 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:28 devstack sudo[111038]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4" returned: 0 in 0.674s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.682s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1141062746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a0d31dc-4419-42ea-b7d0-81929129fb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:25Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Creating volume 7a0d31dc-4419-42ea-b7d0-81929129fb33 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:28 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde31c17-2a8e-44d3-8ff3-ca60395dc330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891b9918-e1ef-4103-91e3-5ada041b39c4', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e69b10f-a5ad-4084-a168-26320aad581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:28 devstack sudo[111046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 1073741824 Jun 29 03:19:28 devstack sudo[111046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:28 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume volume-891b9918-e1ef-4103-91e3-5ada041b39c4 (891b9918-e1ef-4103-91e3-5ada041b39c4): created successfully Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e69b10f-a5ad-4084-a168-26320aad581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (bf4aa612-600c-4b2d-a651-4a464ecb21b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a2ababb4-b4ab-4ce8-8822-f5e1ec577ee3 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created volume successfully. Jun 29 03:19:28 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-54075030-9cdc-4f64-960d-ab8fe29f56f2" returned: 0 in 0.659s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-quobyte-54075030-9cdc-4f64-960d-ab8fe29f56f2" released by "delete_volume" :: held 1.514s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Created reservations ['cdcae3ae-a476-4c04-afe6-51c8066b46d5', '3a595d11-364c-4d54-98cd-de791360c2a8', 'c762ebc5-4170-4749-b840-119d4036713d', '2efed53e-376f-49d3-9577-7ad01b12c33e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:28 devstack sudo[111052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:28 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:29 devstack sudo[111046]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 1073741824" returned: 0 in 0.838s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:29 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 Jun 29 03:19:29 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:29 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.702s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Deleted volume successfully. Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-0bdf4274-3d9b-4104-a18c-91198c952ee6 tempest-VolumesSnapshotNegativeTestJSON-1730691255 None] Lock "cinder-54075030-9cdc-4f64-960d-ab8fe29f56f2-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:29 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33" returned: 0 in 0.654s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.834s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-995914345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2eeae8c-1872-484c-a429-11728013ba5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:26Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Creating volume a2eeae8c-1872-484c-a429-11728013ba5b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:29 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:29 devstack sudo[111059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b 1073741824 Jun 29 03:19:29 devstack sudo[111059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d79d8284-d85b-47ee-b2de-1cd0b4c28d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a0d31dc-4419-42ea-b7d0-81929129fb33', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d326c34c-ca19-4918-b665-92329d0cf63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:29 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 (7a0d31dc-4419-42ea-b7d0-81929129fb33): created successfully Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d326c34c-ca19-4918-b665-92329d0cf63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (ec15e255-d42e-4086-b019-5898a4352a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-79651e3b-7478-4977-ac20-b2dfb9fc280e tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created volume successfully. Jun 29 03:19:30 devstack sudo[111059]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b 1073741824" returned: 0 in 0.992s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:30 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b Jun 29 03:19:30 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:31 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b" returned: 0 in 0.671s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.188s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-452284161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1807ed9-19e5-40d8-a30d-101f2f211d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564ca889fab842b78292dee271d12ca3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:26Z,use_quota=True,user_id='088fa13487ae4863a4134293589d037a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Creating volume b1807ed9-19e5-40d8-a30d-101f2f211d9b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:31 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f208b528-5f90-43c9-8749-500feef7374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2eeae8c-1872-484c-a429-11728013ba5b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:31 devstack sudo[111068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b 1073741824 Jun 29 03:19:31 devstack sudo[111068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d458d4c-f875-46ab-9575-5ad36feb262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:31 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume volume-a2eeae8c-1872-484c-a429-11728013ba5b (a2eeae8c-1872-484c-a429-11728013ba5b): created successfully Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d458d4c-f875-46ab-9575-5ad36feb262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (64759ac9-046b-4ec9-9e15-4ffcb463f540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-761911db-04f5-4e5e-bcb9-09df0de50256 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created volume successfully. Jun 29 03:19:32 devstack sudo[111068]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b 1073741824" returned: 0 in 0.878s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:32 devstack sudo[111074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b Jun 29 03:19:32 devstack sudo[111074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:33 devstack sudo[111074]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b" returned: 0 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4be57e-65c3-4e5b-bfec-0459163550f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d405e467-b114-42a5-9e77-4b55cc159c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:33 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Volume volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b (b1807ed9-19e5-40d8-a30d-101f2f211d9b): created successfully Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d405e467-b114-42a5-9e77-4b55cc159c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Flow 'volume_create_manager' (92cf6e30-a31f-4b91-9675-cb63f2362a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-fdfa8c52-e541-40fb-bb74-c2109172492a tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created volume successfully. Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-b1807ed9-19e5-40d8-a30d-101f2f211d9b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-b1807ed9-19e5-40d8-a30d-101f2f211d9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-quobyte-b1807ed9-19e5-40d8-a30d-101f2f211d9b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-b1807ed9-19e5-40d8-a30d-101f2f211d9b" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b8aba-4550-44ea-aed9-66ebc60f2457]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:34 devstack sudo[111077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b Jun 29 03:19:34 devstack sudo[111077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:34 devstack sudo[111077]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b" returned: 0 in 0.756s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:34 devstack sudo[111082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b Jun 29 03:19:34 devstack sudo[111082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:35 devstack sudo[111082]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b1807ed9-19e5-40d8-a30d-101f2f211d9b" returned: 0 in 0.705s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-b1807ed9-19e5-40d8-a30d-101f2f211d9b" released by "delete_volume" :: held 1.515s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created reservations ['7b6d3f13-e327-4326-9210-414df241fc57', 'd64339e5-66a7-4cb7-98a6-0b2edc8dde30', 'd0a3fbd6-0901-4753-93ee-fa108f1fbfaa', '992936ee-ec60-48a4-a8cc-aef564d0ade3'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:35 devstack sudo[111085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:35 devstack sudo[111085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-a2eeae8c-1872-484c-a429-11728013ba5b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-a2eeae8c-1872-484c-a429-11728013ba5b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-quobyte-a2eeae8c-1872-484c-a429-11728013ba5b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-a2eeae8c-1872-484c-a429-11728013ba5b" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[83699fc5-6757-408d-94dd-3d12baac4612]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:36 devstack sudo[111085]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.710s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Deleted volume successfully. Jun 29 03:19:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-40abbe32-e1e6-4049-9ad5-b28cc36060dd tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-b1807ed9-19e5-40d8-a30d-101f2f211d9b-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:36 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b Jun 29 03:19:36 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:37 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b" returned: 0 in 0.918s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:37 devstack sudo[111094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b Jun 29 03:19:37 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:37 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-a2eeae8c-1872-484c-a429-11728013ba5b" returned: 0 in 0.664s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-a2eeae8c-1872-484c-a429-11728013ba5b" released by "delete_volume" :: held 1.634s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:37 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created reservations ['ee7b108b-751f-4c33-ad51-da78e91c09c9', '685f1070-9573-4f44-ae89-6703250db8a6', '43d2ac93-8501-4690-8246-4d4088eb89c1', 'eb7f2a86-ed8e-4405-9e58-89d5ea5fe7da'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:38 devstack sudo[111098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:38 devstack sudo[111098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-7a0d31dc-4419-42ea-b7d0-81929129fb33-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-7a0d31dc-4419-42ea-b7d0-81929129fb33-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-quobyte-7a0d31dc-4419-42ea-b7d0-81929129fb33" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-7a0d31dc-4419-42ea-b7d0-81929129fb33" acquired by "delete_volume" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[251d3fbf-3e11-45a8-9959-bb2856b4046e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:38 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 Jun 29 03:19:38 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:38 devstack sudo[111098]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Deleted volume successfully. Jun 29 03:19:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a9e12ece-fd00-4826-b38c-812df26fb652 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-a2eeae8c-1872-484c-a429-11728013ba5b-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:39 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33" returned: 0 in 0.882s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:39 devstack sudo[111106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33 Jun 29 03:19:39 devstack sudo[111106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:40 devstack sudo[111106]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-7a0d31dc-4419-42ea-b7d0-81929129fb33" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-7a0d31dc-4419-42ea-b7d0-81929129fb33" released by "delete_volume" :: held 1.700s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created reservations ['d76c0554-82bc-4974-bc74-c130cd81a694', '5ce76344-c3c7-4199-aed9-b8eefaeaf000', '1688a0ae-7524-42c0-b0f7-29fbccf285e6', 'e2f04c36-bce1-4f33-84dc-13bb1dc95889'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:40 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:40 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-891b9918-e1ef-4103-91e3-5ada041b39c4-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-891b9918-e1ef-4103-91e3-5ada041b39c4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-quobyte-891b9918-e1ef-4103-91e3-5ada041b39c4" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-891b9918-e1ef-4103-91e3-5ada041b39c4" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d6ef1d-44f7-4c36-a776-df02d2749c9e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:41 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 Jun 29 03:19:41 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:41 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.720s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:41 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Deleted volume successfully. Jun 29 03:19:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-be9cd72b-3961-46f9-a19b-4ce7296ee0b4 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-7a0d31dc-4419-42ea-b7d0-81929129fb33-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:41 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4" returned: 0 in 0.922s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:41 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4 Jun 29 03:19:41 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:42 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-891b9918-e1ef-4103-91e3-5ada041b39c4" returned: 0 in 0.726s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-891b9918-e1ef-4103-91e3-5ada041b39c4" released by "delete_volume" :: held 1.708s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created reservations ['16662b86-0ed0-4858-9837-e76aac213d20', '4b38d0be-ba2c-4bdd-b86a-cd5f4c6772f6', 'e17fc211-1109-4c43-938e-a65453f961c4', '2152dc64-0c5d-4979-83f7-4a7a91f83319'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:42 devstack sudo[111157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:42 devstack sudo[111157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-bb5e8580-25b2-42bb-b098-e21dd68c18b5-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-bb5e8580-25b2-42bb-b098-e21dd68c18b5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-quobyte-bb5e8580-25b2-42bb-b098-e21dd68c18b5" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-bb5e8580-25b2-42bb-b098-e21dd68c18b5" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ab28d6-2f5d-4819-bc3b-2df4caaa4a8e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:43 devstack sudo[111159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 Jun 29 03:19:43 devstack sudo[111159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:43 devstack sudo[111157]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.686s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Deleted volume successfully. Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-bd69e547-17f0-4347-a350-301a4a926edb tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-891b9918-e1ef-4103-91e3-5ada041b39c4-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:43 devstack sudo[111159]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5" returned: 0 in 0.796s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:43 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5 Jun 29 03:19:43 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:44 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-bb5e8580-25b2-42bb-b098-e21dd68c18b5" returned: 0 in 0.676s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-bb5e8580-25b2-42bb-b098-e21dd68c18b5" released by "delete_volume" :: held 1.516s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created reservations ['9eedec2e-938f-4b34-bc4d-657f660ec8a2', 'fa483895-3a7b-4843-b56b-9073c6d5a775', 'e4e6cc39-b77a-486f-b447-4f268b299330', '9d8a3ef2-2be8-4bc0-bd70-9ee4247bec0a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:44 devstack sudo[111168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:44 devstack sudo[111168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-b83d5682-0649-4011-aeb8-16be3ebca621-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-b83d5682-0649-4011-aeb8-16be3ebca621-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "cinder-quobyte-b83d5682-0649-4011-aeb8-16be3ebca621" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-b83d5682-0649-4011-aeb8-16be3ebca621" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6861989-81e8-4948-916e-9d7e7decc101]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:45 devstack sudo[111168]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.733s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:45 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Deleted volume successfully. Jun 29 03:19:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-88d28e82-c82a-43c5-8369-f6710e28c45b tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-bb5e8580-25b2-42bb-b098-e21dd68c18b5-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:45 devstack sudo[111171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 Jun 29 03:19:45 devstack sudo[111171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:46 devstack sudo[111171]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621" returned: 0 in 0.782s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:46 devstack sudo[111177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621 Jun 29 03:19:46 devstack sudo[111177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:47 devstack sudo[111177]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b83d5682-0649-4011-aeb8-16be3ebca621" returned: 0 in 0.824s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-quobyte-b83d5682-0649-4011-aeb8-16be3ebca621" released by "delete_volume" :: held 1.652s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Created reservations ['81bdf61c-7469-4a9c-bc19-a3a988d1af07', '07756340-2ee0-4f7f-9279-7374ef854003', '280fbbdf-e273-47e1-8262-46a42b8e91e4', '7bac99ab-118f-4de8-8b18-eab25bd1962e'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:47 devstack sudo[111180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:19:47 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:47 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.657s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:19:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Deleted volume successfully. Jun 29 03:19:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-82164071-a7b3-41b0-8759-f2a09b9259f9 tempest-CreateVolumesFromSourceVolumeTest-1553296996 None] Lock "cinder-b83d5682-0649-4011-aeb8-16be3ebca621-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:19:50 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Flow 'volume_create_manager' (2de5d61b-f13a-441a-8efd-c5efcabf0b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:50 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c548494-fc6d-40e4-9bf0-f63c0157f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c548494-fc6d-40e4-9bf0-f63c0157f970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-16307066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09eb1cdddfd54f13a4e22d1a070b7585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:51Z,use_quota=True,user_id='435eb9ed7ada40929af219db156cecd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca56bff-3c0f-4f96-a8a8-d273e9fb3934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca56bff-3c0f-4f96-a8a8-d273e9fb3934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777780c3-d3e5-436c-9b2c-5cf0687ccd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777780c3-d3e5-436c-9b2c-5cf0687ccd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8', 'volume_name': 'volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77645af4-7fd3-4c25-84b8-b08d20e9efb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77645af4-7fd3-4c25-84b8-b08d20e9efb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999d346f-7d39-4404-99c8-dbc6f7dbf756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:51 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Volume f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8', 'volume_size': 1} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-16307066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09eb1cdddfd54f13a4e22d1a070b7585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:51Z,use_quota=True,user_id='435eb9ed7ada40929af219db156cecd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Creating volume f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:51 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:51 devstack sudo[111184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 1073741824 Jun 29 03:19:51 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:51 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 1073741824" returned: 0 in 0.881s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:52 devstack sudo[111190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:19:52 devstack sudo[111190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:52 devstack sudo[111190]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999d346f-7d39-4404-99c8-dbc6f7dbf756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08bea3d-ccbd-424b-8c8a-d882e37b5a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:52 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Volume volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 (f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8): created successfully Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c08bea3d-ccbd-424b-8c8a-d882e37b5a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:52 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Flow 'volume_create_manager' (2de5d61b-f13a-441a-8efd-c5efcabf0b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:52 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4796cbe2-51a7-4923-83a7-e995792d1732 tempest-VolumeDependencyTests-1685924052 None] Created volume successfully. Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Creating offline snapshot 60d59943-e979-46d3-b6bb-618fd482f3c1 of volume f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Flow 'volume_create_manager' (ec2573bf-be8a-47c9-b8dc-cda4f0987a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc7b8a6-9365-422b-af61-16e2c8c34762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[289d25ff-fd85-49fe-a197-16e616f525c9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbc7b8a6-9365-422b-af61-16e2c8c34762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-955234272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4172533e-26a4-41e7-a2bf-fa7ae43f8c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e790adb3cbb4276bb66c254ea046bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:53Z,use_quota=True,user_id='5f94a8c484ec4cb78fbd594a1ec66bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8101e921-78cc-4852-a757-8fd8c6cd0ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8101e921-78cc-4852-a757-8fd8c6cd0ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a3ca0d-7d7d-4530-9093-48a7b257d888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6a3ca0d-7d7d-4530-9093-48a7b257d888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4172533e-26a4-41e7-a2bf-fa7ae43f8c70', 'volume_name': 'volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9262de91-5fb9-43db-a572-c083cc637f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9262de91-5fb9-43db-a572-c083cc637f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaa20e0-fd28-4995-ab3b-cfdc7c1a062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Volume 4172533e-26a4-41e7-a2bf-fa7ae43f8c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70', 'volume_size': 1} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:53 devstack sudo[111194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:19:53 devstack sudo[111194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Flow 'volume_create_manager' (b815e513-101f-49b0-90a4-a73b9c2aed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbd5f1c-a196-43b0-a1ac-56d3a842e238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbd5f1c-a196-43b0-a1ac-56d3a842e238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2101447676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08a52b3-b04c-4014-9129-c8f6c041fe2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e790adb3cbb4276bb66c254ea046bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:54Z,use_quota=True,user_id='5f94a8c484ec4cb78fbd594a1ec66bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652da184-4c6e-4ef8-94fa-6ad8c55f9f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (652da184-4c6e-4ef8-94fa-6ad8c55f9f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182d7428-4614-484b-beee-7297e79a1fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182d7428-4614-484b-beee-7297e79a1fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08a52b3-b04c-4014-9129-c8f6c041fe2c', 'volume_name': 'volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147ff49e-68eb-461f-9f06-5991eb701364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147ff49e-68eb-461f-9f06-5991eb701364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e902cf43-57a6-467f-9d97-9636c9014344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:53 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Volume d08a52b3-b04c-4014-9129-c8f6c041fe2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c', 'volume_size': 1} Jun 29 03:19:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:54 devstack sudo[111194]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 0.834s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:54 devstack sudo[111199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 1G Jun 29 03:19:54 devstack sudo[111199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:55 devstack sudo[111199]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 1G" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:55 devstack sudo[111205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 Jun 29 03:19:55 devstack sudo[111205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:55 devstack sudo[111205]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1" returned: 0 in 0.720s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:55 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 is being set with open permissions: ugo+rw Jun 29 03:19:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:56 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 Jun 29 03:19:56 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:56 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:56 devstack sudo[111216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info Jun 29 03:19:56 devstack sudo[111216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:57 devstack sudo[111216]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info" returned: 0 in 0.712s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:57 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info is being set with open permissions: ugo+rw Jun 29 03:19:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:57 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info Jun 29 03:19:57 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:58 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.info" returned: 0 in 0.653s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.588s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.441s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-955234272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4172533e-26a4-41e7-a2bf-fa7ae43f8c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e790adb3cbb4276bb66c254ea046bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:53Z,use_quota=True,user_id='5f94a8c484ec4cb78fbd594a1ec66bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Creating volume 4172533e-26a4-41e7-a2bf-fa7ae43f8c70 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:58 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:58 devstack sudo[111223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 1073741824 Jun 29 03:19:58 devstack sudo[111223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:58 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-15821f03-4e47-4eea-ace2-a44050b27018 tempest-VolumeDependencyTests-1685924052 None] Create snapshot completed successfully Jun 29 03:19:59 devstack sudo[111223]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 1073741824" returned: 0 in 0.941s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:59 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 Jun 29 03:19:59 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Flow 'volume_create_manager' (f6e6b1ca-5640-40f4-8a35-c1b58b4de39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f003e310-c888-4d7e-b29a-dc38d417b3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f003e310-c888-4d7e-b29a-dc38d417b3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-888745265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d45404-06be-40b6-9d7f-72feb3110fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09eb1cdddfd54f13a4e22d1a070b7585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60d59943-e979-46d3-b6bb-618fd482f3c1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:59Z,use_quota=True,user_id='435eb9ed7ada40929af219db156cecd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e103ef-daf7-43e9-9848-e51b3f2d35bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e103ef-daf7-43e9-9848-e51b3f2d35bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f443732e-906a-4e0f-be68-869dab88fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f443732e-906a-4e0f-be68-869dab88fa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b0d45404-06be-40b6-9d7f-72feb3110fcb', 'volume_name': 'volume-b0d45404-06be-40b6-9d7f-72feb3110fcb', 'volume_size': 1, 'snapshot_id': '60d59943-e979-46d3-b6bb-618fd482f3c1'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63987b1c-1154-47b7-ba2b-0ce5ddcdf506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63987b1c-1154-47b7-ba2b-0ce5ddcdf506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f3ae94-c6d4-4dae-8bd7-2dc69ed43d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Volume b0d45404-06be-40b6-9d7f-72feb3110fcb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b0d45404-06be-40b6-9d7f-72feb3110fcb', 'volume_size': 1, 'snapshot_id': '60d59943-e979-46d3-b6bb-618fd482f3c1'} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:59 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" returned: 0 in 0.697s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.948s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2101447676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08a52b3-b04c-4014-9129-c8f6c041fe2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e790adb3cbb4276bb66c254ea046bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:19:54Z,use_quota=True,user_id='5f94a8c484ec4cb78fbd594a1ec66bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Creating volume d08a52b3-b04c-4014-9129-c8f6c041fe2c {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:19:59 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfaa20e0-fd28-4995-ab3b-cfdc7c1a062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:59 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c 1073741824 Jun 29 03:19:59 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f46351-ea70-4c00-a379-ffa729990a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=125,cinder:SELECT=97,cinder:DELETE=14,cinder:INSERT=34 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:19:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Volume volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 (4172533e-26a4-41e7-a2bf-fa7ae43f8c70): created successfully Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f46351-ea70-4c00-a379-ffa729990a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:19:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Flow 'volume_create_manager' (ec2573bf-be8a-47c9-b8dc-cda4f0987a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:19:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dec08efd-48e1-4e4b-83bf-a48819397dbe tempest-TestServerVolumeAttachmentScenario-149317603 None] Created volume successfully. Jun 29 03:20:00 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c 1073741824" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:00 devstack sudo[111237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c Jun 29 03:20:00 devstack sudo[111237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:01 devstack sudo[111237]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c" returned: 0 in 0.709s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.108s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-quobyte-60d59943-e979-46d3-b6bb-618fd482f3c1-b0d45404-06be-40b6-9d7f-72feb3110fcb" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e902cf43-57a6-467f-9d97-9636c9014344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baacd774-06a6-4664-95fd-00fa6f11c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-60d59943-e979-46d3-b6bb-618fd482f3c1-b0d45404-06be-40b6-9d7f-72feb3110fcb" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Creating volume b0d45404-06be-40b6-9d7f-72feb3110fcb from snapshot 60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-quobyte-b0d45404-06be-40b6-9d7f-72feb3110fcb" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:01 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Volume volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c (d08a52b3-b04c-4014-9129-c8f6c041fe2c): created successfully Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baacd774-06a6-4664-95fd-00fa6f11c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Flow 'volume_create_manager' (b815e513-101f-49b0-90a4-a73b9c2aed89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-b0d45404-06be-40b6-9d7f-72feb3110fcb" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] snapshot: 60d59943-e979-46d3-b6bb-618fd482f3c1, volume: b0d45404-06be-40b6-9d7f-72feb3110fcb, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:20:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b5885621-3a2c-4ff9-8be9-98def6a75bf1 tempest-TestServerVolumeAttachmentScenario-149317603 None] Created volume successfully. Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c79179-977d-4e8c-9282-cebf7dcf272d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:01 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 Jun 29 03:20:01 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:02 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1" returned: 0 in 0.859s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:20:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:20:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:20:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b5c61-ec14-49da-9a6b-8605f38a39d0]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:02 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:20:02 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:03 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 0.865s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:03 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:20:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:03 devstack sudo[111257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb Jun 29 03:20:03 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:08 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb" returned: 0 in 5.112s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:08 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99523da-31cf-40bf-b5aa-4df4ffecf0bc]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:08 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:20:08 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:09 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 1.064s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:09 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:20:09 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Converted 1024.00 MB image at 200.27 MB/s Jun 29 03:20:09 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb is being set with open permissions: ugo+rw Jun 29 03:20:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:09 devstack sudo[111331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb Jun 29 03:20:09 devstack sudo[111331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:10 devstack sudo[111331]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb" returned: 0 in 0.927s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-b0d45404-06be-40b6-9d7f-72feb3110fcb" released by "_copy_volume_from_snapshot" :: held 8.969s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-60d59943-e979-46d3-b6bb-618fd482f3c1-b0d45404-06be-40b6-9d7f-72feb3110fcb" released by "_create_volume_from_snapshot" :: held 9.019s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.056s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f3ae94-c6d4-4dae-8bd7-2dc69ed43d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d45404-06be-40b6-9d7f-72feb3110fcb', 'volume_size': 1, 'snapshot_id': '60d59943-e979-46d3-b6bb-618fd482f3c1'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8ecc2a-e64c-4e82-be72-5f7759aea945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:10 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Volume volume-b0d45404-06be-40b6-9d7f-72feb3110fcb (b0d45404-06be-40b6-9d7f-72feb3110fcb): created successfully Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8ecc2a-e64c-4e82-be72-5f7759aea945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Flow 'volume_create_manager' (f6e6b1ca-5640-40f4-8a35-c1b58b4de39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:20:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-77e0df44-784a-4727-9f75-e40eaf3c6dbe tempest-VolumeDependencyTests-1685924052 None] Created volume successfully. Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-60d59943-e979-46d3-b6bb-618fd482f3c1-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-60d59943-e979-46d3-b6bb-618fd482f3c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-quobyte-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-quobyte-60d59943-e979-46d3-b6bb-618fd482f3c1" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-60d59943-e979-46d3-b6bb-618fd482f3c1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Deleting offline snapshot 60d59943-e979-46d3-b6bb-618fd482f3c1 of volume f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] snapshot_file for this snap is: volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d186cb-9c46-419b-b353-02a2270a1694]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:11 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 Jun 29 03:20:11 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:12 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1" returned: 0 in 0.772s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:20:12 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cab42e-09f8-40ca-a910-b9c5544b6a2a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:12 devstack sudo[111383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:20:12 devstack sudo[111383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:13 devstack sudo[111383]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 0.913s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:13 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 Jun 29 03:20:13 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:14 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1" returned: 0 in 1.022s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:14 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1 Jun 29 03:20:14 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:14 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8.60d59943-e979-46d3-b6bb-618fd482f3c1" returned: 0 in 0.687s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-60d59943-e979-46d3-b6bb-618fd482f3c1" released by "_delete_snapshot" :: held 3.544s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" released by "delete_snapshot" :: held 3.579s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Created reservations ['daa20924-feed-47b4-bfce-4d98b7e45844', '73237616-0971-4db6-8445-5e7c3916b3f7', '82e0cc20-3888-4e4e-a98f-d9bbe4020aa5', 'ecd27903-0a42-43d3-961c-268df7e3cd96'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:20:15 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Delete snapshot completed successfully. Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-91089a4f-25a3-4116-bad9-d69bc8dd47bb tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-60d59943-e979-46d3-b6bb-618fd482f3c1-delete_snapshot" released by "delete_snapshot" :: held 3.793s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-quobyte-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6277f95-dc71-499e-9549-715dff598e43]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:15 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:20:15 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:16 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 0.851s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:16 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8 Jun 29 03:20:16 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:17 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" returned: 0 in 0.694s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8" released by "delete_volume" :: held 1.601s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Created reservations ['5eb0b054-b209-4080-9a07-dfa337c939e9', 'bb8d60a9-39e4-4717-8095-d186664124aa', 'a20faea3-c820-4baa-97eb-0dab135d1d58', '25d26151-c99c-4b79-a7bd-925d70336a70'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:17 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:20:17 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:17 devstack sudo[111419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:20:17 devstack sudo[111419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-b0d45404-06be-40b6-9d7f-72feb3110fcb-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-b0d45404-06be-40b6-9d7f-72feb3110fcb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "cinder-quobyte-b0d45404-06be-40b6-9d7f-72feb3110fcb" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-b0d45404-06be-40b6-9d7f-72feb3110fcb" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b3b29a-2b67-438c-a46d-150dee26acde]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:18 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.800s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:20:18 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb Jun 29 03:20:18 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:18 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Deleted volume successfully. Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffea8a3d-c260-428e-b69d-394b47d42994 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-f6b3cf9b-0980-49ee-90f2-0d22bf5d63c8-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:18 devstack sudo[111419]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:20:18 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb" returned: 0 in 0.793s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:18 devstack sudo[111428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb Jun 29 03:20:18 devstack sudo[111428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:19 devstack sudo[111428]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b0d45404-06be-40b6-9d7f-72feb3110fcb" returned: 0 in 0.768s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-quobyte-b0d45404-06be-40b6-9d7f-72feb3110fcb" released by "delete_volume" :: held 1.622s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Created reservations ['1e34d904-a589-4dc5-9a98-755aeade479e', '96a35bae-3029-4158-9334-84cac51ab491', 'dfd0b730-c10f-40e1-81c5-0dc31228b715', '8ee02da5-f6c6-4c95-b405-420d1e33a49f'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:19 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:20:19 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:20 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.683s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:20 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:20:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Deleted volume successfully. Jun 29 03:20:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-79bf8e3d-b41f-4f51-9168-6cde66ef67d5 tempest-VolumeDependencyTests-1685924052 None] Lock "cinder-b0d45404-06be-40b6-9d7f-72feb3110fcb-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=75,cinder:DELETE=9,cinder:UPDATE=114,cinder:INSERT=28 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Flow 'volume_create_manager' (4843c861-fc73-4b8e-8889-069805c19c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4fa9c3-e84a-41f7-a8be-9eefce7126f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4fa9c3-e84a-41f7-a8be-9eefce7126f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b34608c-2a03-455e-b8e8-9a71a82c3a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203a07c90c64884ba889f73d70a7c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:20:25Z,use_quota=True,user_id='f022e4a522db4c11bc619012fd3e5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea86a54-0413-4f8b-9756-7cb9c0db3224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea86a54-0413-4f8b-9756-7cb9c0db3224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c08bfc-3a41-42dd-b0a1-584f3a309baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c08bfc-3a41-42dd-b0a1-584f3a309baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b34608c-2a03-455e-b8e8-9a71a82c3a60', 'volume_name': 'volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60', 'volume_size': 1, 'image_id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08eb102-d610-4b47-beee-aaf2bf4ce843', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20212d3b90dd01ba13e0fa1f4dd385e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7203a07c90c64884ba889f73d70a7c3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70b6d56d53b58ef21e8a1223cddaac8c945fdaddc30823bd73830e0e6b69008e787db0cafd47ea252482d90d2e596b03238474a5221b8543e5b9e18b279dc16b', 'id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'created_at': datetime.datetime(2026, 6, 29, 1, 20, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 20, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08eb102-d610-4b47-beee-aaf2bf4ce843/file', 'properties': {}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3f70d7-deaa-4747-812b-581f66d6c8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3f70d7-deaa-4747-812b-581f66d6c8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe15788b-7073-41c9-a720-19580bcc3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Volume 1b34608c-2a03-455e-b8e8-9a71a82c3a60: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60', 'volume_size': 1, 'image_id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08eb102-d610-4b47-beee-aaf2bf4ce843', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20212d3b90dd01ba13e0fa1f4dd385e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7203a07c90c64884ba889f73d70a7c3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70b6d56d53b58ef21e8a1223cddaac8c945fdaddc30823bd73830e0e6b69008e787db0cafd47ea252482d90d2e596b03238474a5221b8543e5b9e18b279dc16b', 'id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'created_at': datetime.datetime(2026, 6, 29, 1, 20, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 20, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08eb102-d610-4b47-beee-aaf2bf4ce843/file', 'properties': {}}, 'image_service': } Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Trying to clone 1b34608c-2a03-455e-b8e8-9a71a82c3a60 from image f08eb102-d610-4b47-beee-aaf2bf4ce843 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f08eb102-d610-4b47-beee-aaf2bf4ce843', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:20:25 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9cd30c-fb05-4266-8446-72e4de72f337]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:25 devstack sudo[111461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD Jun 29 03:20:25 devstack sudo[111461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:26 devstack sudo[111461]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD" returned: 0 in 0.744s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:26 devstack sudo[111465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD Jun 29 03:20:26 devstack sudo[111465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:27 devstack sudo[111465]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD" returned: 1 in 0.783s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:20:27 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Temporary image f08eb102-d610-4b47-beee-aaf2bf4ce843 is fetched for user f022e4a522db4c11bc619012fd3e5aff. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:20:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfeb8d9-27e1-4a19-af04-d41e69358db2]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:27 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD Jun 29 03:20:27 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:28 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:28 devstack sudo[111475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD Jun 29 03:20:28 devstack sudo[111475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:28 devstack sudo[111475]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD" returned: 1 in 0.780s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b34608c-2a03-455e-b8e8-9a71a82c3a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7203a07c90c64884ba889f73d70a7c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:20:25Z,use_quota=True,user_id='f022e4a522db4c11bc619012fd3e5aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Creating volume 1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:20:28 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:20:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:28 devstack sudo[111480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 1073741824 Jun 29 03:20:28 devstack sudo[111480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:29 devstack sudo[111480]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 1073741824" returned: 0 in 0.845s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:29 devstack sudo[111485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:29 devstack sudo[111485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:30 devstack sudo[111485]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 0 in 0.648s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:30 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:20:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:30 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Attempting download of f08eb102-d610-4b47-beee-aaf2bf4ce843 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08eb102-d610-4b47-beee-aaf2bf4ce843', 'metadata': {}}])) to volume 1b34608c-2a03-455e-b8e8-9a71a82c3a60. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:20:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46a4a7f-b742-4e00-909a-b4f22a061aa4]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:30 devstack sudo[111488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m Jun 29 03:20:30 devstack sudo[111488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:31 devstack sudo[111488]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m" returned: 0 in 0.702s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:31 devstack sudo[111492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m Jun 29 03:20:31 devstack sudo[111492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:32 devstack sudo[111492]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m" returned: 1 in 0.771s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f08eb102-d610-4b47-beee-aaf2bf4ce843_ezfhi03m' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:20:32 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2178124-e1e0-499d-b75a-8175664211b2]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:32 devstack sudo[111496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD Jun 29 03:20:32 devstack sudo[111496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:32 devstack sudo[111496]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD" returned: 0 in 0.706s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:32 devstack sudo[111500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD Jun 29 03:20:32 devstack sudo[111500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:33 devstack sudo[111500]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD" returned: 1 in 0.714s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:20:33 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] f08eb102-d610-4b47-beee-aaf2bf4ce843 was raw, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:20:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:33 devstack sudo[111507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:33 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:34 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 0 in 0.766s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:34 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f08eb102-d610-4b47-beee-aaf2bf4ce843_uhh91pr0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:20:34 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:20:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:34 devstack sudo[111515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 1G Jun 29 03:20:34 devstack sudo[111515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:34 devstack sudo[111515]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 1G" returned: 0 in 0.664s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c4feb3-35de-4d91-a3b5-64d431d1590f]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:35 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:35 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:35 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 0 in 0.704s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:35 devstack sudo[111524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:35 devstack sudo[111524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:36 devstack sudo[111524]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 1 in 0.749s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Downloaded image f08eb102-d610-4b47-beee-aaf2bf4ce843 ((None, [{'url': 'file:///opt/stack/data/glance/images/f08eb102-d610-4b47-beee-aaf2bf4ce843', 'metadata': {}}])) to volume 1b34608c-2a03-455e-b8e8-9a71a82c3a60 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Temporary image f08eb102-d610-4b47-beee-aaf2bf4ce843 for user f022e4a522db4c11bc619012fd3e5aff is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Marking volume 1b34608c-2a03-455e-b8e8-9a71a82c3a60 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Copying metadata from image f08eb102-d610-4b47-beee-aaf2bf4ce843 to 1b34608c-2a03-455e-b8e8-9a71a82c3a60. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Creating volume glance metadata for volume 1b34608c-2a03-455e-b8e8-9a71a82c3a60 backed by image f08eb102-d610-4b47-beee-aaf2bf4ce843 with: {'image_id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '20212d3b90dd01ba13e0fa1f4dd385e7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe15788b-7073-41c9-a720-19580bcc3e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60', 'volume_size': 1, 'image_id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f08eb102-d610-4b47-beee-aaf2bf4ce843', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20212d3b90dd01ba13e0fa1f4dd385e7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7203a07c90c64884ba889f73d70a7c3e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '70b6d56d53b58ef21e8a1223cddaac8c945fdaddc30823bd73830e0e6b69008e787db0cafd47ea252482d90d2e596b03238474a5221b8543e5b9e18b279dc16b', 'id': 'f08eb102-d610-4b47-beee-aaf2bf4ce843', 'created_at': datetime.datetime(2026, 6, 29, 1, 20, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 20, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f08eb102-d610-4b47-beee-aaf2bf4ce843/file', 'properties': {}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8dfbc9-3a5c-4fa2-ab07-9b111e79bc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:20:36 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Volume volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 (1b34608c-2a03-455e-b8e8-9a71a82c3a60): created successfully Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c8dfbc9-3a5c-4fa2-ab07-9b111e79bc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Flow 'volume_create_manager' (4843c861-fc73-4b8e-8889-069805c19c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:20:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2c4cffad-0742-45fb-b4f9-574a22efa69d tempest-VolumeImageDependencyTests-996200201 None] Created volume successfully. Jun 29 03:20:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Acquiring lock "cinder-1b34608c-2a03-455e-b8e8-9a71a82c3a60-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Lock "cinder-1b34608c-2a03-455e-b8e8-9a71a82c3a60-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Acquiring lock "cinder-quobyte-1b34608c-2a03-455e-b8e8-9a71a82c3a60" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Lock "cinder-quobyte-1b34608c-2a03-455e-b8e8-9a71a82c3a60" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9950ccf9-af52-4c21-8ce7-0a5309180bb1]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfa3d95-bce8-48b4-87d4-071a4b19b254]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:37 devstack sudo[111537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:37 devstack sudo[111537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:37 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 Jun 29 03:20:37 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:37 devstack sudo[111537]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 0 in 0.751s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:37 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:37 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:37 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" returned: 0 in 0.816s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16973c11-c1a8-4d22-9836-b577155294da', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:20:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-52f6d5f8-4377-4337-83b8-e36139049e50 req-6168fe49-a04b-4dce-89e4-766398ba952b tempest-TestServerVolumeAttachmentScenario-149317603 None] attachment_update completed successfully. Jun 29 03:20:38 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 1 in 0.722s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:20:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:38 devstack sudo[111619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60 Jun 29 03:20:38 devstack sudo[111619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:39 devstack sudo[111619]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-1b34608c-2a03-455e-b8e8-9a71a82c3a60" returned: 0 in 0.706s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Lock "cinder-quobyte-1b34608c-2a03-455e-b8e8-9a71a82c3a60" released by "delete_volume" :: held 2.265s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Created reservations ['d4418e20-d23d-4bea-826e-6450dc2a9258', 'e0af79d4-0c2e-4504-8db4-b332722e68c3', '78431178-d714-451f-a8ff-012c85e305c7', '537524e6-de3d-42bf-99ae-3e24d0280c68'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:39 devstack sudo[111940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:20:39 devstack sudo[111940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:40 devstack sudo[111940]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.615s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:40 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:20:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Deleted volume successfully. Jun 29 03:20:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3e4c8e48-471f-4be5-8393-fdc82e6ebf8d tempest-VolumeImageDependencyTests-996200201 None] Lock "cinder-1b34608c-2a03-455e-b8e8-9a71a82c3a60-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:20:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:20:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:20:47 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e54351-b44f-46ee-a78d-0f3070584028]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:20:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:20:47 devstack sudo[111991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c Jun 29 03:20:47 devstack sudo[111991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:20:48 devstack sudo[111991]: pam_unix(sudo:session): session closed for user root Jun 29 03:20:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c" returned: 0 in 0.769s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:20:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.785s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:20:48 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd825dc83-2534-4abc-81f9-a33d4857c3c4', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:20:48 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-c400fa27-ac71-457d-b9ae-01444b156b63 req-be58e299-b097-4971-9b7e-a38b073f2967 tempest-TestServerVolumeAttachmentScenario-149317603 None] attachment_update completed successfully. Jun 29 03:20:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-ea8f9ded-6d75-4418-9535-d0d245d6814f req-d305e7db-0fe8-43c1-9c70-d37aaf950a11 tempest-TestServerVolumeAttachmentScenario-149317603 None] Terminate volume connection completed successfully. Jun 29 03:20:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-ea8f9ded-6d75-4418-9535-d0d245d6814f req-d305e7db-0fe8-43c1-9c70-d37aaf950a11 tempest-TestServerVolumeAttachmentScenario-149317603 None] Deleting attachment d825dc83-2534-4abc-81f9-a33d4857c3c4. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:20:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-e09d83df-2891-410f-b173-f65c154a1391 req-537064b1-1128-4078-be72-f4cb4d544ec2 tempest-TestServerVolumeAttachmentScenario-149317603 None] Terminate volume connection completed successfully. Jun 29 03:20:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-e09d83df-2891-410f-b173-f65c154a1391 req-537064b1-1128-4078-be72-f4cb4d544ec2 tempest-TestServerVolumeAttachmentScenario-149317603 None] Deleting attachment 16973c11-c1a8-4d22-9836-b577155294da. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:21:02 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=47,cinder:INSERT=15,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:21:07 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "cinder-d08a52b3-b04c-4014-9129-c8f6c041fe2c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-d08a52b3-b04c-4014-9129-c8f6c041fe2c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "cinder-quobyte-d08a52b3-b04c-4014-9129-c8f6c041fe2c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-quobyte-d08a52b3-b04c-4014-9129-c8f6c041fe2c" acquired by "delete_volume" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b739007d-72ed-4c31-b075-b02ab679ca03]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:08 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c Jun 29 03:21:08 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:08 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c" returned: 0 in 0.706s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:08 devstack sudo[112090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c Jun 29 03:21:08 devstack sudo[112090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:09 devstack sudo[112090]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d08a52b3-b04c-4014-9129-c8f6c041fe2c" returned: 0 in 0.617s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-quobyte-d08a52b3-b04c-4014-9129-c8f6c041fe2c" released by "delete_volume" :: held 1.362s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Created reservations ['731e6812-72d9-4825-afcf-c0ddc663ae3f', 'b4ed8211-ee4b-437d-bd98-0580e018a51d', '683e9021-5437-4991-bc60-c40922311d61', '81d26714-f18f-45ba-9761-fce05f7d7763'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:09 devstack sudo[112093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:21:09 devstack sudo[112093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:10 devstack sudo[112093]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.615s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:21:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Deleted volume successfully. Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-eae12e85-bcbc-4a3f-bf4b-6d6ac903e01e tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-d08a52b3-b04c-4014-9129-c8f6c041fe2c-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "cinder-4172533e-26a4-41e7-a2bf-fa7ae43f8c70-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-4172533e-26a4-41e7-a2bf-fa7ae43f8c70-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "cinder-quobyte-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-quobyte-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" acquired by "delete_volume" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba10ed2f-22f2-4b08-ba4c-ebf1ee7c412e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:21:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:10 devstack sudo[112096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 Jun 29 03:21:10 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:11 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" returned: 0 in 0.754s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:11 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70 Jun 29 03:21:11 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:11 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" returned: 0 in 0.615s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-quobyte-4172533e-26a4-41e7-a2bf-fa7ae43f8c70" released by "delete_volume" :: held 1.406s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Created reservations ['4e8defec-a658-4751-80c4-b384c82909b9', 'a1e4bddf-4daa-47ae-b6dd-e1a3c17f19ad', 'dbc0a0e6-0503-48fa-9057-cabf994c7769', 'c8caa8d7-04ef-4ba9-a843-7741371c2cca'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:11 devstack sudo[112104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:21:11 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:12 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.608s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:12 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:21:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Deleted volume successfully. Jun 29 03:21:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-a822fe6b-9986-4aa9-a461-0746fa96df37 tempest-TestServerVolumeAttachmentScenario-149317603 None] Lock "cinder-4172533e-26a4-41e7-a2bf-fa7ae43f8c70-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:17 devstack sudo[112114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:21:17 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:18 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.801s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:21:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:21:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:21:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:21:21 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=33,cinder:UPDATE=26,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:21:22 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=21,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Flow 'volume_create_manager' (6f5c5cf8-8356-41bc-a646-3116f767d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5028697e-e0b4-4670-aec9-6ebce5cf5293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5028697e-e0b4-4670-aec9-6ebce5cf5293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-447935721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1f62cb-2266-47ac-a57c-2c8975f2693e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d2272c142c46d7b400b6ac5cc892e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:21:40Z,use_quota=True,user_id='35cafab41e7443c791f9a86a5a847bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92479b62-9a82-48b1-8658-25413219f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92479b62-9a82-48b1-8658-25413219f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ed7857-4fbe-46fd-98bd-93ae964103ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ed7857-4fbe-46fd-98bd-93ae964103ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1f62cb-2266-47ac-a57c-2c8975f2693e', 'volume_name': 'volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea0c599-714c-4186-8ea9-0b683e122a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea0c599-714c-4186-8ea9-0b683e122a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440ba40a-105a-4e5d-b257-fddff07edd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:40 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Volume ea1f62cb-2266-47ac-a57c-2c8975f2693e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e', 'volume_size': 1} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-447935721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1f62cb-2266-47ac-a57c-2c8975f2693e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d2272c142c46d7b400b6ac5cc892e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:21:40Z,use_quota=True,user_id='35cafab41e7443c791f9a86a5a847bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Creating volume ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:21:40 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:21:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:40 devstack sudo[112130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e 1073741824 Jun 29 03:21:40 devstack sudo[112130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:41 devstack sudo[112130]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e 1073741824" returned: 0 in 0.879s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:21:41 devstack sudo[112139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:21:41 devstack sudo[112139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:21:41 devstack sudo[112139]: pam_unix(sudo:session): session closed for user root Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.633s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440ba40a-105a-4e5d-b257-fddff07edd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d378966d-525b-473b-8374-313dab17a6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:21:41 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Volume volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e (ea1f62cb-2266-47ac-a57c-2c8975f2693e): created successfully Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d378966d-525b-473b-8374-313dab17a6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:21:41 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Flow 'volume_create_manager' (6f5c5cf8-8356-41bc-a646-3116f767d356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:21:41 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dc468bd3-fa12-44c9-914c-d8649630798e tempest-TestStampPattern-1535467329 None] Created volume successfully. Jun 29 03:21:51 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:21:52 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:17 devstack sudo[112318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:22:17 devstack sudo[112318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:18 devstack sudo[112318]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.623s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:22:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:22:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:22:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:22:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:20 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbde9a6-126c-4c56-9bc4-57a6921ea45a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:20 devstack sudo[112339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:22:20 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:21 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.734s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.751s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:21 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '29cfae9d-abd5-4ec7-81b9-b85c29a57a9d', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:22:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-db823170-c543-4648-9c45-4cb17089e405 req-05218406-1bc8-41c4-b2b1-e047d05ab638 tempest-TestStampPattern-1535467329 None] attachment_update completed successfully. Jun 29 03:22:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-0ec17fb5-250c-4a0a-a89f-10767207453f req-478959ac-21f1-401c-908c-012e22dfeee7 tempest-TestStampPattern-1535467329 None] Terminate volume connection completed successfully. Jun 29 03:22:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-0ec17fb5-250c-4a0a-a89f-10767207453f req-478959ac-21f1-401c-908c-012e22dfeee7 tempest-TestStampPattern-1535467329 None] Deleting attachment 29cfae9d-abd5-4ec7-81b9-b85c29a57a9d. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:22:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Creating offline snapshot f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb of volume ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:22:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee54309-d65f-4c36-8f0d-7b481c5cdcc5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:31 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:22:31 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:32 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.722s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:32 devstack sudo[112793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb 1G Jun 29 03:22:32 devstack sudo[112793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:33 devstack sudo[112793]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb 1G" returned: 0 in 0.743s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:33 devstack sudo[112799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb Jun 29 03:22:33 devstack sudo[112799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:33 devstack sudo[112799]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" returned: 0 in 0.654s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:33 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb is being set with open permissions: ugo+rw Jun 29 03:22:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:33 devstack sudo[112804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb Jun 29 03:22:33 devstack sudo[112804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:34 devstack sudo[112804]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" returned: 0 in 0.604s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:34 devstack sudo[112807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info Jun 29 03:22:34 devstack sudo[112807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:35 devstack sudo[112807]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info" returned: 0 in 0.603s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:35 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info is being set with open permissions: ugo+rw Jun 29 03:22:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:35 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info Jun 29 03:22:35 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:35 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.info" returned: 0 in 0.632s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.038s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e15cb38a-9e00-41c1-898a-6465a65c7af5 tempest-TestStampPattern-1535467329 None] Create snapshot completed successfully Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Flow 'volume_create_manager' (88987b58-8d5b-4946-aafa-3178d7a64b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79880dd8-b56c-4b6a-8b8a-43e028e04ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79880dd8-b56c-4b6a-8b8a-43e028e04ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:22:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-578313541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d12757-5f61-4867-a36f-3d629458805a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d2272c142c46d7b400b6ac5cc892e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:22:45Z,use_quota=True,user_id='35cafab41e7443c791f9a86a5a847bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e53cb2-45bb-41d1-8e7d-284e8194e0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e53cb2-45bb-41d1-8e7d-284e8194e0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521a6f86-8302-4944-b920-74f96b1fd801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521a6f86-8302-4944-b920-74f96b1fd801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8d12757-5f61-4867-a36f-3d629458805a', 'volume_name': 'volume-f8d12757-5f61-4867-a36f-3d629458805a', 'volume_size': 1, 'snapshot_id': 'f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a13a2f-2999-4f3c-a6d2-6f37a95051ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a13a2f-2999-4f3c-a6d2-6f37a95051ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bce51e6-2c5e-4992-b8ea-276c41245763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:45 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Volume f8d12757-5f61-4867-a36f-3d629458805a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8d12757-5f61-4867-a36f-3d629458805a', 'volume_size': 1, 'snapshot_id': 'f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb'} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-quobyte-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb-f8d12757-5f61-4867-a36f-3d629458805a" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb-f8d12757-5f61-4867-a36f-3d629458805a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Creating volume f8d12757-5f61-4867-a36f-3d629458805a from snapshot f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-quobyte-f8d12757-5f61-4867-a36f-3d629458805a" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f8d12757-5f61-4867-a36f-3d629458805a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] snapshot: f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb, volume: f8d12757-5f61-4867-a36f-3d629458805a, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0562b47-b354-484d-953c-8cec357b3d95]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:45 devstack sudo[112887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb Jun 29 03:22:45 devstack sudo[112887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:46 devstack sudo[112887]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" returned: 0 in 0.788s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:22:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:22:46 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:22:46 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8857a1-78b7-4452-b067-071503556f5b]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:46 devstack sudo[112895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:22:46 devstack sudo[112895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:47 devstack sudo[112895]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.751s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:47 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:22:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:47 devstack sudo[112900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a Jun 29 03:22:47 devstack sudo[112900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:51 devstack sudo[112900]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a" returned: 0 in 4.727s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf0c1c5-24d1-41ef-9a69-a7eb87cd5218]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:22:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:52 devstack sudo[112914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:22:52 devstack sudo[112914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:53 devstack sudo[112914]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 1.135s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:22:53 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Converted 1024.00 MB image at 216.58 MB/s Jun 29 03:22:53 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a is being set with open permissions: ugo+rw Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:22:53 devstack sudo[112921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a Jun 29 03:22:53 devstack sudo[112921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:22:53 devstack sudo[112921]: pam_unix(sudo:session): session closed for user root Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a" returned: 0 in 0.807s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f8d12757-5f61-4867-a36f-3d629458805a" released by "_copy_volume_from_snapshot" :: held 8.319s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb-f8d12757-5f61-4867-a36f-3d629458805a" released by "_create_volume_from_snapshot" :: held 8.351s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:22:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.369s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:22:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bce51e6-2c5e-4992-b8ea-276c41245763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d12757-5f61-4867-a36f-3d629458805a', 'volume_size': 1, 'snapshot_id': 'f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f235411-dbad-4d80-a479-d7c8c01739dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:22:54 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Volume volume-f8d12757-5f61-4867-a36f-3d629458805a (f8d12757-5f61-4867-a36f-3d629458805a): created successfully Jun 29 03:22:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f235411-dbad-4d80-a479-d7c8c01739dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:22:54 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Flow 'volume_create_manager' (88987b58-8d5b-4946-aafa-3178d7a64b97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:22:54 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7f42d590-d0eb-490c-8bb4-6b3be272d597 tempest-TestStampPattern-1535467329 None] Created volume successfully. Jun 29 03:23:12 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:12 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:17 devstack sudo[113025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:23:17 devstack sudo[113025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:18 devstack sudo[113025]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.665s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:23:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:23:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:23:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:23:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:23:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:23:42 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a87b4ce-1e76-4cd0-a736-cc3ccdeda0f7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:23:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:42 devstack sudo[113067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a Jun 29 03:23:42 devstack sudo[113067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:43 devstack sudo[113067]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a" returned: 0 in 0.732s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.750s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:23:43 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c', 'name': 'volume-f8d12757-5f61-4867-a36f-3d629458805a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '264dfafc-97a1-40f5-a8de-aff5917dd148', 'enforce_multipath': True} {{(pid=93518) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 29 03:23:43 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-ad4ef9af-72df-410a-9032-661452603e25 req-e7366e6e-0064-483f-8218-a2f4ea7d2a7c tempest-TestStampPattern-1535467329 None] attachment_update completed successfully. Jun 29 03:23:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [req-07ea5623-bffb-4d96-9876-faa8d63296c6 req-b2b18bd6-dffd-40a4-bbdb-4c7bdfdd8785 tempest-TestStampPattern-1535467329 None] Terminate volume connection completed successfully. Jun 29 03:23:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [req-07ea5623-bffb-4d96-9876-faa8d63296c6 req-b2b18bd6-dffd-40a4-bbdb-4c7bdfdd8785 tempest-TestStampPattern-1535467329 None] Deleting attachment 264dfafc-97a1-40f5-a8de-aff5917dd148. {{(pid=93518) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 29 03:23:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-f8d12757-5f61-4867-a36f-3d629458805a-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:23:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Lock "cinder-f8d12757-5f61-4867-a36f-3d629458805a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:23:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-quobyte-f8d12757-5f61-4867-a36f-3d629458805a" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:23:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f8d12757-5f61-4867-a36f-3d629458805a" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:23:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[44092047-a710-495a-8665-05af59900fda]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:23:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:59 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a Jun 29 03:23:59 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:23:59 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Jun 29 03:23:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a" returned: 0 in 0.751s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:23:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:23:59 devstack sudo[113589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a Jun 29 03:23:59 devstack sudo[113589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:00 devstack sudo[113589]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f8d12757-5f61-4867-a36f-3d629458805a" returned: 0 in 0.608s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f8d12757-5f61-4867-a36f-3d629458805a" released by "delete_volume" :: held 1.400s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Created reservations ['e2e29be9-abbc-4d2e-af49-85ca451e8245', 'ea95cbf9-d3ce-4118-b75d-870a499814c6', '98f9d947-caf9-478c-b0b6-396bdb8e14d5', '4b2fdadd-1798-4278-8f12-653f47549274'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:00 devstack sudo[113592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:00 devstack sudo[113592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:01 devstack sudo[113592]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.617s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:01 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Deleted volume successfully. Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-487dcd1d-c31b-42bf-b613-62dab01386c1 tempest-TestStampPattern-1535467329 None] Lock "cinder-f8d12757-5f61-4867-a36f-3d629458805a-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Lock "cinder-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-quobyte-ea1f62cb-2266-47ac-a57c-2c8975f2693e" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-ea1f62cb-2266-47ac-a57c-2c8975f2693e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-quobyte-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Deleting offline snapshot f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb of volume ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] snapshot_file for this snap is: volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01fdaa-c1c6-4783-b3b9-7f286aba770f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:01 devstack sudo[113595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb Jun 29 03:24:01 devstack sudo[113595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:02 devstack sudo[113595]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" returned: 0 in 0.711s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:24:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9c48b7-b758-4a8c-809c-a591dd74daf2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:02 devstack sudo[113600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:24:02 devstack sudo[113600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:02 devstack sudo[113600]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.766s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:02 devstack sudo[113605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb Jun 29 03:24:02 devstack sudo[113605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:03 devstack sudo[113605]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" returned: 0 in 0.718s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:03 devstack sudo[113610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb Jun 29 03:24:03 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:04 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e.f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" returned: 0 in 0.602s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb" released by "_delete_snapshot" :: held 2.887s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-ea1f62cb-2266-47ac-a57c-2c8975f2693e" released by "delete_snapshot" :: held 2.907s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:04 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Created reservations ['60ae983c-4644-4559-bfbc-78dbab258853', 'ec0e738d-554c-4321-a949-71e65ca18760', 'd392281d-dcfe-49d1-ba0f-dfe730fd38ce', '46b04cc1-724a-4d30-bb5c-0068805c18bf'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Delete snapshot completed successfully. Jun 29 03:24:04 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09db3ad4-b7ce-4981-b6c1-48df9159bb66 tempest-TestStampPattern-1535467329 None] Lock "cinder-f0bbdcc7-d27d-4dcc-ad46-1852449d3ccb-delete_snapshot" released by "delete_snapshot" :: held 3.037s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-ea1f62cb-2266-47ac-a57c-2c8975f2693e-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Lock "cinder-ea1f62cb-2266-47ac-a57c-2c8975f2693e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Acquiring lock "cinder-quobyte-ea1f62cb-2266-47ac-a57c-2c8975f2693e" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-ea1f62cb-2266-47ac-a57c-2c8975f2693e" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:11 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f705ec-132c-438d-8409-ebc57e3fa7fd]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:11 devstack sudo[113662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:24:11 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:12 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.723s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:12 devstack sudo[113667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e Jun 29 03:24:12 devstack sudo[113667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:13 devstack sudo[113667]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea1f62cb-2266-47ac-a57c-2c8975f2693e" returned: 0 in 0.615s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Lock "cinder-quobyte-ea1f62cb-2266-47ac-a57c-2c8975f2693e" released by "delete_volume" :: held 1.394s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Created reservations ['985c4e80-f840-4d5e-80c2-f46cb331e6a0', 'dfbfeee1-ebf5-4e9c-9f28-3ec42a587b0d', 'f0010956-cc92-4454-a33e-7301a0f10593', '41f3860a-b42c-4166-b99f-c3141b1d233a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:13 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:13 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:13 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.662s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:13 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Deleted volume successfully. Jun 29 03:24:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-31fed36a-cef7-4a51-b0c8-ad6555c45bc1 tempest-TestStampPattern-1535467329 None] Lock "cinder-ea1f62cb-2266-47ac-a57c-2c8975f2693e-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:17 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:17 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:18 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.759s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:24:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:24:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:24:23 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:23 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=24,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (3bd160f2-1023-4708-a11d-d4493711d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbd5ec8-0ed1-4336-97db-d2c4f2229208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbd5ec8-0ed1-4336-97db-d2c4f2229208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1602637860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538a2691-029b-40ef-9298-71282b076724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:25Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf80e6-4acd-4743-b623-e869b4380bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdaf80e6-4acd-4743-b623-e869b4380bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66786c2-6afe-48ee-8f30-8e4db2cf8dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66786c2-6afe-48ee-8f30-8e4db2cf8dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '538a2691-029b-40ef-9298-71282b076724', 'volume_name': 'volume-538a2691-029b-40ef-9298-71282b076724', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab93a39-ccf9-4c0d-9359-dddae3fd0761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab93a39-ccf9-4c0d-9359-dddae3fd0761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe3033-c954-4e48-b8cf-3b567e38697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:24 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Volume 538a2691-029b-40ef-9298-71282b076724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-538a2691-029b-40ef-9298-71282b076724', 'volume_size': 1} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1602637860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538a2691-029b-40ef-9298-71282b076724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:25Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Creating volume 538a2691-029b-40ef-9298-71282b076724 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:24 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:24 devstack sudo[113693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 1073741824 Jun 29 03:24:24 devstack sudo[113693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (1025b3e0-6e46-4882-959e-19008b786830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317ac0bc-6c4b-4837-8292-a5bc727e5619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (317ac0bc-6c4b-4837-8292-a5bc727e5619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843455654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:25Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b369dc-33fa-4228-bf00-8a94687347b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b369dc-33fa-4228-bf00-8a94687347b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b758ff8-c48a-498e-bccc-8af170306731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b758ff8-c48a-498e-bccc-8af170306731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b', 'volume_name': 'volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e102dbe-b204-45cd-9273-06bc39f703b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e102dbe-b204-45cd-9273-06bc39f703b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48fe50-e987-4fe9-a522-d1d441e2ed30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Volume e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b', 'volume_size': 1} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (80779120-638c-4f72-9e91-0173e59da554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0841f496-157e-4dee-8c70-0be44254ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0841f496-157e-4dee-8c70-0be44254ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-316666315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:25Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6800b16b-6938-4365-b787-71f981860d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6800b16b-6938-4365-b787-71f981860d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18c78fb-3c99-4c2a-bd89-b86f66130c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a18c78fb-3c99-4c2a-bd89-b86f66130c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4', 'volume_name': 'volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41419444-c537-4a3f-bf61-36af23326751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41419444-c537-4a3f-bf61-36af23326751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98971f60-e26d-4e56-85c3-5914d9ec815b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Volume 8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4', 'volume_size': 1} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (001a4731-da09-4ae8-b28e-5337647a8184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:25 devstack sudo[113693]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7bd58a-9faf-4731-a246-acf2fc2c265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 1073741824" returned: 0 in 0.987s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7bd58a-9faf-4731-a246-acf2fc2c265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2008162982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68115f08-e85a-41bc-91b7-2f1debe10431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:26Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e0cde3-6528-42f9-878a-4320e470a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e0cde3-6528-42f9-878a-4320e470a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a3807-3d44-45fb-8810-0601c610b375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9a3807-3d44-45fb-8810-0601c610b375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68115f08-e85a-41bc-91b7-2f1debe10431', 'volume_name': 'volume-68115f08-e85a-41bc-91b7-2f1debe10431', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7b693c-749c-4c8f-9f99-960d0e568397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7b693c-749c-4c8f-9f99-960d0e568397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a82e1f8-d426-4bf7-aa4b-57f58d3707db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Volume 68115f08-e85a-41bc-91b7-2f1debe10431: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68115f08-e85a-41bc-91b7-2f1debe10431', 'volume_size': 1} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:25 devstack sudo[113698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 Jun 29 03:24:25 devstack sudo[113698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (ff9d1639-c7b4-4f40-9828-2e43d67d11a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e480dd3d-26a5-4238-9107-5c1e54485a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e480dd3d-26a5-4238-9107-5c1e54485a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786608368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e435ad1-3f3e-4842-8f4a-32dbe4f52413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:26Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afed3d5c-f9c8-46f1-b13e-ebd4fabb0113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afed3d5c-f9c8-46f1-b13e-ebd4fabb0113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3604e02-f7f8-4c39-91ac-8c4e69469ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3604e02-f7f8-4c39-91ac-8c4e69469ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e435ad1-3f3e-4842-8f4a-32dbe4f52413', 'volume_name': 'volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fa41ca-2a7c-45a0-8c03-f349fd9fa325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fa41ca-2a7c-45a0-8c03-f349fd9fa325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3e8cfe-f030-4061-af3e-c418eb802391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:26 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Volume 0e435ad1-3f3e-4842-8f4a-32dbe4f52413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413', 'volume_size': 1} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:26 devstack sudo[113698]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724" returned: 0 in 0.624s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1843455654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:25Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Creating volume e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:26 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe3033-c954-4e48-b8cf-3b567e38697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538a2691-029b-40ef-9298-71282b076724', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:26 devstack sudo[113701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b 1073741824 Jun 29 03:24:26 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc48dcf-38f0-4caa-ad50-3918078d1441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:26 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Volume volume-538a2691-029b-40ef-9298-71282b076724 (538a2691-029b-40ef-9298-71282b076724): created successfully Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc48dcf-38f0-4caa-ad50-3918078d1441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (3bd160f2-1023-4708-a11d-d4493711d27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-378d835b-e385-4282-8ac1-eff0230fac13 tempest-CreateVolumesFromImageTest-1886820766 None] Created volume successfully. Jun 29 03:24:27 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b 1073741824" returned: 0 in 0.862s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:27 devstack sudo[113706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b Jun 29 03:24:27 devstack sudo[113706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:27 devstack sudo[113706]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b" returned: 0 in 0.619s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-316666315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:25Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Creating volume 8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:27 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:28 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 1073741824 Jun 29 03:24:28 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48fe50-e987-4fe9-a522-d1d441e2ed30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2c3968-5fad-4b21-a5e1-122a638cb404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:28 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Volume volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b (e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b): created successfully Jun 29 03:24:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c2c3968-5fad-4b21-a5e1-122a638cb404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (1025b3e0-6e46-4882-959e-19008b786830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-47cef4dc-a6d8-4579-a5cf-df84a26718f4 tempest-CreateVolumesFromImageTest-1886820766 None] Created volume successfully. Jun 29 03:24:28 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 1073741824" returned: 0 in 0.879s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:28 devstack sudo[113715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 Jun 29 03:24:28 devstack sudo[113715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:29 devstack sudo[113715]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4" returned: 0 in 0.680s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.787s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2008162982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68115f08-e85a-41bc-91b7-2f1debe10431,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:26Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Creating volume 68115f08-e85a-41bc-91b7-2f1debe10431 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:29 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:29 devstack sudo[113718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 1073741824 Jun 29 03:24:29 devstack sudo[113718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98971f60-e26d-4e56-85c3-5914d9ec815b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e1b000-cf8b-4be3-95a5-7227b2e7914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:29 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Volume volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 (8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4): created successfully Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e1b000-cf8b-4be3-95a5-7227b2e7914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:29 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (80779120-638c-4f72-9e91-0173e59da554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2069d267-aebd-40df-99f8-8d65f1240bcc tempest-CreateVolumesFromImageTest-1886820766 None] Created volume successfully. Jun 29 03:24:30 devstack sudo[113718]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 1073741824" returned: 0 in 0.832s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:30 devstack sudo[113724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 Jun 29 03:24:30 devstack sudo[113724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:31 devstack sudo[113724]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431" returned: 0 in 0.671s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.961s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786608368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e435ad1-3f3e-4842-8f4a-32dbe4f52413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb44d66c3284947a8ab61ed8be0355e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:26Z,use_quota=True,user_id='81c74a58aa5c410099373f16bd1e0e9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Creating volume 0e435ad1-3f3e-4842-8f4a-32dbe4f52413 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:31 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a82e1f8-d426-4bf7-aa4b-57f58d3707db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68115f08-e85a-41bc-91b7-2f1debe10431', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:31 devstack sudo[113727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 1073741824 Jun 29 03:24:31 devstack sudo[113727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a3d011-34f4-4d02-a135-47b24774f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:31 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Volume volume-68115f08-e85a-41bc-91b7-2f1debe10431 (68115f08-e85a-41bc-91b7-2f1debe10431): created successfully Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34a3d011-34f4-4d02-a135-47b24774f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:31 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (001a4731-da09-4ae8-b28e-5337647a8184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-35516ebc-ebc3-428d-bfd9-19ef0e3a78b2 tempest-CreateVolumesFromImageTest-1886820766 None] Created volume successfully. Jun 29 03:24:32 devstack sudo[113727]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 1073741824" returned: 0 in 0.877s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:32 devstack sudo[113732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 Jun 29 03:24:32 devstack sudo[113732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:32 devstack sudo[113732]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413" returned: 0 in 0.675s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3e8cfe-f030-4061-af3e-c418eb802391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf478c2-52d1-489d-baa6-6ae64707b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:32 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Volume volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 (0e435ad1-3f3e-4842-8f4a-32dbe4f52413): created successfully Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf478c2-52d1-489d-baa6-6ae64707b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:32 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Flow 'volume_create_manager' (ff9d1639-c7b4-4f40-9828-2e43d67d11a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ab7278e7-8561-4348-b1a7-9a790ef97a16 tempest-CreateVolumesFromImageTest-1886820766 None] Created volume successfully. Jun 29 03:24:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-0e435ad1-3f3e-4842-8f4a-32dbe4f52413-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-0e435ad1-3f3e-4842-8f4a-32dbe4f52413-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-quobyte-0e435ad1-3f3e-4842-8f4a-32dbe4f52413" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-0e435ad1-3f3e-4842-8f4a-32dbe4f52413" acquired by "delete_volume" :: waited 0.016s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[808d6156-2ba5-4715-9fbe-24bbab842f07]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:33 devstack sudo[113735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 Jun 29 03:24:33 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:34 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413" returned: 0 in 0.811s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:34 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413 Jun 29 03:24:34 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:35 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0e435ad1-3f3e-4842-8f4a-32dbe4f52413" returned: 0 in 0.681s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-0e435ad1-3f3e-4842-8f4a-32dbe4f52413" released by "delete_volume" :: held 1.538s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Created reservations ['bef260df-96d8-419c-99f7-a71c4a146c03', '77c2a4df-9180-4259-823c-eac7d0a63de1', 'ce363289-fb68-41b6-829b-3df8a67b1130', '7185789b-0fed-486f-8e5b-52911f6e55b1'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:35 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:35 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-68115f08-e85a-41bc-91b7-2f1debe10431-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-68115f08-e85a-41bc-91b7-2f1debe10431-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-quobyte-68115f08-e85a-41bc-91b7-2f1debe10431" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-68115f08-e85a-41bc-91b7-2f1debe10431" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb2e13-51ed-426c-8559-3eb23cd024d9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:36 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.730s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:36 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Deleted volume successfully. Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-178cfab2-1817-410a-8e31-e823013550d3 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-0e435ad1-3f3e-4842-8f4a-32dbe4f52413-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:36 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 Jun 29 03:24:36 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:36 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431" returned: 0 in 0.761s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:36 devstack sudo[113751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431 Jun 29 03:24:36 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:37 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-68115f08-e85a-41bc-91b7-2f1debe10431" returned: 0 in 0.687s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-68115f08-e85a-41bc-91b7-2f1debe10431" released by "delete_volume" :: held 1.496s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Created reservations ['125b45db-d36b-49e9-a78f-bbd9ac9b9d41', '69efd068-48e0-4e14-9935-9a548ab9800d', '656d2444-a073-4f8b-b6ec-359ec17950c8', '19f4f779-473e-47e8-8912-6f398e8ea8b7'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:37 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:37 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-quobyte-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4" acquired by "delete_volume" :: waited 0.019s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a79cc1-3375-4cee-9c5f-322b7b57d9a4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:38 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.644s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Deleted volume successfully. Jun 29 03:24:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e6436188-6b11-44ea-8527-1bf8a32adf51 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-68115f08-e85a-41bc-91b7-2f1debe10431-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:38 devstack sudo[113758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 Jun 29 03:24:38 devstack sudo[113758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:39 devstack sudo[113758]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4" returned: 0 in 0.746s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:39 devstack sudo[113763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4 Jun 29 03:24:39 devstack sudo[113763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:39 devstack sudo[113763]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4" returned: 0 in 0.605s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4" released by "delete_volume" :: held 1.390s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Created reservations ['396cbf00-f78b-4479-a499-e13824ef476f', '14cc60ea-04f7-4d93-affe-a64ed27a51fe', 'a184a1f3-6f57-4e8d-a58d-af775f3da9d1', '5cc6335c-e813-461b-aa03-8cf491a6a9fc'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:39 devstack sudo[113766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:39 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:40 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.635s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Deleted volume successfully. Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1a1864b3-2232-40f1-bbc0-5463c20f5162 tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-8d3a7dc2-aaa9-4de6-861c-5ef50a77b6c4-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-quobyte-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee60f2e-4bdc-441c-9ba5-83cb83343160]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:40 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b Jun 29 03:24:40 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:41 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b" returned: 0 in 0.726s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:41 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b Jun 29 03:24:41 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:41 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b" returned: 0 in 0.615s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b" released by "delete_volume" :: held 1.380s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Created reservations ['2890e225-ec21-48aa-bfe4-4007beba699d', '330a41d3-672c-4167-a7c2-5de4671d4803', '2afd08ad-205f-4807-966e-5783e76c66c3', '178c6e48-d807-4fea-91ca-2e705f31b88d'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:42 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:42 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-538a2691-029b-40ef-9298-71282b076724-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:42 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.695s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-538a2691-029b-40ef-9298-71282b076724-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Deleted volume successfully. Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-70f244bf-b5fe-459d-bc67-8e09959ed57f tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-e93ab766-0ce2-42b8-8b40-9bf4d0ba9b6b-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "cinder-quobyte-538a2691-029b-40ef-9298-71282b076724" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-538a2691-029b-40ef-9298-71282b076724" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e0dc7d-71c0-4984-b980-47297c05106d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:24:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:42 devstack sudo[113780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 Jun 29 03:24:42 devstack sudo[113780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:43 devstack sudo[113780]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724" returned: 0 in 0.766s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:43 devstack sudo[113819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724 Jun 29 03:24:43 devstack sudo[113819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:44 devstack sudo[113819]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-538a2691-029b-40ef-9298-71282b076724" returned: 0 in 0.634s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-quobyte-538a2691-029b-40ef-9298-71282b076724" released by "delete_volume" :: held 1.443s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Created reservations ['cbfa3df4-59a3-48ad-a4f8-dd394a7af377', 'db9b905e-99b0-4bb2-928e-60442a15d558', 'cb2ac741-26d3-4b4a-a4bb-5c95e4b3c1fd', 'c4530b1d-6f47-49de-947a-b20dea347078'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:44 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:24:44 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:44 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.666s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:44 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:24:44 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Deleted volume successfully. Jun 29 03:24:45 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-05df3916-45e5-4301-bd64-1df50ab6e01a tempest-CreateVolumesFromImageTest-1886820766 None] Lock "cinder-538a2691-029b-40ef-9298-71282b076724-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:24:54 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=31,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=5 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:54 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=39,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=10 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (9220d878-f330-45f6-81a1-af72b016b01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24c91a3-6791-4f80-89f7-45f2cd74048b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a24c91a3-6791-4f80-89f7-45f2cd74048b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250968901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7e8576-939d-4a7a-93a5-d53ba7cac64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:57Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacd9beb-adaa-4cc6-97bc-05b1b5a1d60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cacd9beb-adaa-4cc6-97bc-05b1b5a1d60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae11dfa7-723c-47fd-bb38-37326eb12e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae11dfa7-723c-47fd-bb38-37326eb12e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7e8576-939d-4a7a-93a5-d53ba7cac64d', 'volume_name': 'volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fe229d-4a49-4542-8c44-3ab5daabfa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:56 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2fe229d-4a49-4542-8c44-3ab5daabfa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc0cb42-2e91-4e04-86fd-9dd9298bd886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Volume da7e8576-939d-4a7a-93a5-d53ba7cac64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d', 'volume_size': 1} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-250968901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7e8576-939d-4a7a-93a5-d53ba7cac64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:57Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Creating volume da7e8576-939d-4a7a-93a5-d53ba7cac64d {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:57 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:57 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d 1073741824 Jun 29 03:24:57 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Flow 'volume_create_manager' (ad3fbd47-40ac-4b4b-a878-b2da4b3b2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4ee658-d566-44d4-8e6b-1974ff4e9ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4ee658-d566-44d4-8e6b-1974ff4e9ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfb5333-4b72-43a8-8a04-360b1f39b22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d040994192645dabecba5747a52eae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:57Z,use_quota=True,user_id='3dc8270dfb614993ac4477d80415719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5b24f0-4bfc-4c71-9577-90fbbf7c93ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae5b24f0-4bfc-4c71-9577-90fbbf7c93ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bcd708-8e0e-4315-a1e9-10f2514c2327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68bcd708-8e0e-4315-a1e9-10f2514c2327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfb5333-4b72-43a8-8a04-360b1f39b22e', 'volume_name': 'volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d7b84a-1c21-4d46-9ceb-ca59bcc4072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d7b84a-1c21-4d46-9ceb-ca59bcc4072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4cb228-8bb3-45b9-8979-0aa6c23673d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Volume 6cfb5333-4b72-43a8-8a04-360b1f39b22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e', 'volume_size': 1} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (888a1907-21fa-4574-92e1-99a874025478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d905a661-82a2-417f-818e-bd67449f31b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d905a661-82a2-417f-818e-bd67449f31b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-90378933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657766b0-19ce-45fb-acaf-75a285170c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:57Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2d6a8-1aff-49fc-b76a-065a34f686e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de2d6a8-1aff-49fc-b76a-065a34f686e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af2097b-8c71-4d1e-b187-3453d3c97e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9af2097b-8c71-4d1e-b187-3453d3c97e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657766b0-19ce-45fb-acaf-75a285170c23', 'volume_name': 'volume-657766b0-19ce-45fb-acaf-75a285170c23', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8d845a-6093-431b-82ec-a44070ce3898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8d845a-6093-431b-82ec-a44070ce3898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7753fbe2-03cd-4403-b695-2bad021e34bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:57 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Volume 657766b0-19ce-45fb-acaf-75a285170c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657766b0-19ce-45fb-acaf-75a285170c23', 'volume_size': 1} Jun 29 03:24:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:58 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d 1073741824" returned: 0 in 1.158s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:58 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d Jun 29 03:24:58 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (277dc454-1f3f-4468-8849-82350c4dd8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9b3fd1-1e7e-426e-90d0-08c321510b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9b3fd1-1e7e-426e-90d0-08c321510b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085770952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef11f5c2-faab-4407-bba7-6b817f2a34b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:58Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a81e97-5ed6-4d5c-b733-879cae4e9619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a81e97-5ed6-4d5c-b733-879cae4e9619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6a8740-feb7-4c35-9c06-f5f7f87cb7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f6a8740-feb7-4c35-9c06-f5f7f87cb7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef11f5c2-faab-4407-bba7-6b817f2a34b8', 'volume_name': 'volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ebd447-d129-4731-a3ea-7224c6bb2d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ebd447-d129-4731-a3ea-7224c6bb2d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c763b4-605b-4956-9bc4-78b1ff1e7b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume ef11f5c2-faab-4407-bba7-6b817f2a34b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8', 'volume_size': 1} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (db89525e-bff8-4f80-bc83-744c7a5530c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4549fc-a106-4d87-aa36-eaec46f119af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb4549fc-a106-4d87-aa36-eaec46f119af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750623131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f233f25-1fa5-4bb0-8230-c41caf030a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:58Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbc397a-46bb-46c6-80d8-2f5f6da22964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afbc397a-46bb-46c6-80d8-2f5f6da22964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0318768c-691d-4dde-9245-59292ea507ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0318768c-691d-4dde-9245-59292ea507ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f233f25-1fa5-4bb0-8230-c41caf030a7b', 'volume_name': 'volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0425e50c-50ae-4d89-adeb-423eb394006a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0425e50c-50ae-4d89-adeb-423eb394006a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ed4a2-7119-4a75-9029-466c78cad03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:58 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Volume 6f233f25-1fa5-4bb0-8230-c41caf030a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b', 'volume_size': 1} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:58 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:58 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (d1a1d335-c020-4c7e-97ed-0d4ded220284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333e1fcf-42ed-4d67-8062-e5df4091cceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d" returned: 0 in 0.813s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.732s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfb5333-4b72-43a8-8a04-360b1f39b22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d040994192645dabecba5747a52eae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:57Z,use_quota=True,user_id='3dc8270dfb614993ac4477d80415719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Creating volume 6cfb5333-4b72-43a8-8a04-360b1f39b22e {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:24:59 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333e1fcf-42ed-4d67-8062-e5df4091cceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-45625986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6662f66-4452-4e61-8aaa-d46d2088630e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:59Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b23d336-ab88-45a8-a45a-755162746cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b23d336-ab88-45a8-a45a-755162746cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e 1073741824 Jun 29 03:24:59 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a94a06f-4ef2-4599-a262-5807f445b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a94a06f-4ef2-4599-a262-5807f445b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6662f66-4452-4e61-8aaa-d46d2088630e', 'volume_name': 'volume-e6662f66-4452-4e61-8aaa-d46d2088630e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6a512d-ca23-4521-9243-a7feb2e05f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6a512d-ca23-4521-9243-a7feb2e05f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96208abf-bbad-4be8-afdb-278614e7731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Volume e6662f66-4452-4e61-8aaa-d46d2088630e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6662f66-4452-4e61-8aaa-d46d2088630e', 'volume_size': 1} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (4b385854-fdd2-45a3-803c-1d87f46d295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2c3066-223c-49e6-94f3-7b5b541b8f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc0cb42-2e91-4e04-86fd-9dd9298bd886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881c717d-4414-4c8c-848f-a0512bc4e0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd2c3066-223c-49e6-94f3-7b5b541b8f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1657318869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42c1da4-1c93-4135-a44d-2e26cfb242f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:59Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b579533-6101-4bb0-aebc-51370d26dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b579533-6101-4bb0-aebc-51370d26dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61799e8a-9232-40a1-8049-4b7fff5f4df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61799e8a-9232-40a1-8049-4b7fff5f4df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42c1da4-1c93-4135-a44d-2e26cfb242f8', 'volume_name': 'volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05121d72-577d-4d47-b398-c11abc41a840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05121d72-577d-4d47-b398-c11abc41a840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdf9085-cf9b-4bcf-bf21-b99fb17609a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:24:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Volume f42c1da4-1c93-4135-a44d-2e26cfb242f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8', 'volume_size': 1} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:24:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Volume volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d (da7e8576-939d-4a7a-93a5-d53ba7cac64d): created successfully Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881c717d-4414-4c8c-848f-a0512bc4e0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:24:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (9220d878-f330-45f6-81a1-af72b016b01a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:24:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9019a080-95c1-4427-933b-521dc4c3dabf tempest-CreateVolumesFromImageTest-1516569272 None] Created volume successfully. Jun 29 03:25:00 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e 1073741824" returned: 0 in 0.927s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:00 devstack sudo[113887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e Jun 29 03:25:00 devstack sudo[113887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:00 devstack sudo[113887]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e" returned: 0 in 0.634s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.967s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-90378933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657766b0-19ce-45fb-acaf-75a285170c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:57Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Creating volume 657766b0-19ce-45fb-acaf-75a285170c23 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:00 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:00 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 1073741824 Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4cb228-8bb3-45b9-8979-0aa6c23673d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:00 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1387fc31-c2c8-451c-a975-3fec77c85792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:00 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Volume volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e (6cfb5333-4b72-43a8-8a04-360b1f39b22e): created successfully Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1387fc31-c2c8-451c-a975-3fec77c85792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Flow 'volume_create_manager' (ad3fbd47-40ac-4b4b-a878-b2da4b3b2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6309b4ca-b183-41ad-9591-5e708208393c tempest-CinderUnicodeTest-424036225 None] Created volume successfully. Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Flow 'volume_create_manager' (57914e13-e8a0-49c2-877d-96948e2cd410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41725d33-c46d-4cc8-8cf8-a681940babdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41725d33-c46d-4cc8-8cf8-a681940babdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc4d2ab-1aea-4a09-b5b1-20274d1da155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb38cc83ddd34dc4b6ca3cd87b4357f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:02Z,use_quota=True,user_id='87b333cf228240c2b50efa04cbc0a2ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(899ad4f3-f5c3-4c35-9827-217aaa097269),volume_type_id=899ad4f3-f5c3-4c35-9827-217aaa097269)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99b0d51-5fa4-4fbc-92be-fdd5a2d853cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99b0d51-5fa4-4fbc-92be-fdd5a2d853cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffa3798-dff5-4548-a61b-403c5b37b369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:25:01 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 1073741824" returned: 0 in 0.994s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:01 devstack sudo[113896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 Jun 29 03:25:01 devstack sudo[113896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffa3798-dff5-4548-a61b-403c5b37b369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5dc4d2ab-1aea-4a09-b5b1-20274d1da155', 'volume_name': 'volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155', 'volume_size': 1, 'image_id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b675da3-33c3-4d41-be89-8a7e8892444f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7d57f66028d4fc497a8a419c70ba9cb2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb38cc83ddd34dc4b6ca3cd87b4357f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3655efeca343fb6404ff57d8d3d4da2aa5d1a5f3b8bb5b8ca30550297cede237b18cd44f2bf14545f42537f83933bbb57897887aa5de47bbf50328b91629d18', 'id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'created_at': datetime.datetime(2026, 6, 29, 1, 24, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 25, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b675da3-33c3-4d41-be89-8a7e8892444f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf2ebc7-18d0-41d7-9beb-b58058687c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf2ebc7-18d0-41d7-9beb-b58058687c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d707aea-eac2-4c35-840e-5ba81e0d7a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Volume 5dc4d2ab-1aea-4a09-b5b1-20274d1da155: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155', 'volume_size': 1, 'image_id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b675da3-33c3-4d41-be89-8a7e8892444f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7d57f66028d4fc497a8a419c70ba9cb2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb38cc83ddd34dc4b6ca3cd87b4357f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3655efeca343fb6404ff57d8d3d4da2aa5d1a5f3b8bb5b8ca30550297cede237b18cd44f2bf14545f42537f83933bbb57897887aa5de47bbf50328b91629d18', 'id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'created_at': datetime.datetime(2026, 6, 29, 1, 24, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 25, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b675da3-33c3-4d41-be89-8a7e8892444f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Trying to clone 5dc4d2ab-1aea-4a09-b5b1-20274d1da155 from image 1b675da3-33c3-4d41-be89-8a7e8892444f at location (None, [{'url': 'file:///opt/stack/data/glance/images/1b675da3-33c3-4d41-be89-8a7e8892444f', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:25:02 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[35aeb77e-be7e-4318-aeb7-624894f9a53f]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Flow 'volume_create_manager' (cfd8837e-94e1-474b-ab1d-3d4140ba2004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e5df18-a8db-46e4-827c-8e23fab1ae59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e5df18-a8db-46e4-827c-8e23fab1ae59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-338444940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becaa754-2524-4e16-805f-c59f7ea7e273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d040994192645dabecba5747a52eae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:02Z,use_quota=True,user_id='3dc8270dfb614993ac4477d80415719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack sudo[113901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD Jun 29 03:25:02 devstack sudo[113901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff800cb-d281-40a2-b273-1c9e3775c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dff800cb-d281-40a2-b273-1c9e3775c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a973048-d7dd-434f-82d4-070820955270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a973048-d7dd-434f-82d4-070820955270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'becaa754-2524-4e16-805f-c59f7ea7e273', 'volume_name': 'volume-becaa754-2524-4e16-805f-c59f7ea7e273', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b8618b-a091-4e83-afed-ba125a0ea8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b8618b-a091-4e83-afed-ba125a0ea8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c4567a-e697-4ad6-afb8-7c8ac92cee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Volume becaa754-2524-4e16-805f-c59f7ea7e273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-becaa754-2524-4e16-805f-c59f7ea7e273', 'volume_size': 1} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:02 devstack sudo[113896]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23" returned: 0 in 0.738s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.934s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2085770952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef11f5c2-faab-4407-bba7-6b817f2a34b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:58Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Creating volume ef11f5c2-faab-4407-bba7-6b817f2a34b8 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:02 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7753fbe2-03cd-4403-b695-2bad021e34bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657766b0-19ce-45fb-acaf-75a285170c23', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack sudo[113904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 1073741824 Jun 29 03:25:02 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b7568f-c771-405a-b6ee-e1b860b70dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:02 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Volume volume-657766b0-19ce-45fb-acaf-75a285170c23 (657766b0-19ce-45fb-acaf-75a285170c23): created successfully Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b7568f-c771-405a-b6ee-e1b860b70dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (888a1907-21fa-4574-92e1-99a874025478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dba0b93e-273a-4034-81fd-b9353ab418ed tempest-CreateVolumesFromImageTest-1516569272 None] Created volume successfully. Jun 29 03:25:02 devstack sudo[113901]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD" returned: 0 in 0.733s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:03 devstack sudo[113908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD Jun 29 03:25:03 devstack sudo[113908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:03 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 1073741824" returned: 0 in 0.874s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:03 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 Jun 29 03:25:03 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:03 devstack sudo[113908]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD" returned: 1 in 0.740s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Temporary image 1b675da3-33c3-4d41-be89-8a7e8892444f is fetched for user 87b333cf228240c2b50efa04cbc0a2ef. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3475644a-c42a-4f54-9621-e17ef303788c]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:03 devstack sudo[113919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD Jun 29 03:25:03 devstack sudo[113919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:04 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8" returned: 0 in 0.636s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.212s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-750623131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f233f25-1fa5-4bb0-8230-c41caf030a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:58Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Creating volume 6f233f25-1fa5-4bb0-8230-c41caf030a7b {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:04 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:04 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b 1073741824 Jun 29 03:25:04 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c763b4-605b-4956-9bc4-78b1ff1e7b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565bba55-ef74-447a-ab02-ce0417e66d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 (ef11f5c2-faab-4407-bba7-6b817f2a34b8): created successfully Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565bba55-ef74-447a-ab02-ce0417e66d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (277dc454-1f3f-4468-8849-82350c4dd8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:04 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c0e93079-ae0a-4a41-a9ec-bd39eb83e034 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created volume successfully. Jun 29 03:25:04 devstack sudo[113919]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:04 devstack sudo[113926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD Jun 29 03:25:04 devstack sudo[113926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (355eda0d-ac32-463e-9f8e-de58310675e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36147b9-d35a-4d32-870c-ef1fdb93cdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36147b9-d35a-4d32-870c-ef1fdb93cdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447929726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38667b3-c3a4-4c2f-baea-7d2ff642461d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:05Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99c5a1c-6a74-4015-87ed-edb295f28204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e99c5a1c-6a74-4015-87ed-edb295f28204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea98f3-bab8-41ca-8e61-57f68dadd51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deea98f3-bab8-41ca-8e61-57f68dadd51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38667b3-c3a4-4c2f-baea-7d2ff642461d', 'volume_name': 'volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41df226-487d-447b-9da3-b5f878b16f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41df226-487d-447b-9da3-b5f878b16f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f9d50a-d513-46cf-9651-2174aa1a1afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:04 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume b38667b3-c3a4-4c2f-baea-7d2ff642461d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d', 'volume_size': 1} Jun 29 03:25:04 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:05 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b 1073741824" returned: 0 in 0.988s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:05 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b Jun 29 03:25:05 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (b821b8b0-43b1-4274-ab88-60c723933b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fee8a91-57d9-4553-afaf-f0ebc2a38c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fee8a91-57d9-4553-afaf-f0ebc2a38c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4358072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea585ac1-139b-4d2b-863b-15410271ac12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:05Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5037e54-7c4d-4b0b-8cf7-b3cf474d3ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5037e54-7c4d-4b0b-8cf7-b3cf474d3ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08990a77-838c-4a4c-aba2-8ac3fe32dc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08990a77-838c-4a4c-aba2-8ac3fe32dc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea585ac1-139b-4d2b-863b-15410271ac12', 'volume_name': 'volume-ea585ac1-139b-4d2b-863b-15410271ac12', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad06783-a645-43d6-aa5a-041e19f054cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad06783-a645-43d6-aa5a-041e19f054cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcdc004-1542-4b65-a04d-2daacb1aa26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume ea585ac1-139b-4d2b-863b-15410271ac12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea585ac1-139b-4d2b-863b-15410271ac12', 'volume_size': 1} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:05 devstack sudo[113926]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD" returned: 1 in 0.928s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (28829616-85ce-48ac-9863-c45a0815159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cbe0e2-4aca-476a-93ca-3806f5ad3f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cbe0e2-4aca-476a-93ca-3806f5ad3f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929241237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dd35af-9924-4b76-9947-a9b7288130b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:06Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ce06ee-016f-48de-8b16-8ea7ab0a1141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ce06ee-016f-48de-8b16-8ea7ab0a1141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0a59b8-43a6-4933-b7e1-5133ed6e9e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0a59b8-43a6-4933-b7e1-5133ed6e9e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dd35af-9924-4b76-9947-a9b7288130b0', 'volume_name': 'volume-d6dd35af-9924-4b76-9947-a9b7288130b0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd8f6e-7d5b-4e4b-924a-2f4139288ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09bd8f6e-7d5b-4e4b-924a-2f4139288ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937b2c32-60f3-41fc-966b-b811d532380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume d6dd35af-9924-4b76-9947-a9b7288130b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dd35af-9924-4b76-9947-a9b7288130b0', 'volume_size': 1} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:05 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b" returned: 0 in 0.779s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.712s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-45625986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6662f66-4452-4e61-8aaa-d46d2088630e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:59Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Creating volume e6662f66-4452-4e61-8aaa-d46d2088630e {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:05 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:05 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e 1073741824 Jun 29 03:25:05 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ed4a2-7119-4a75-9029-466c78cad03b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7056c3-5648-4647-8fa8-46e850b9167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:05 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Volume volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b (6f233f25-1fa5-4bb0-8230-c41caf030a7b): created successfully Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a7056c3-5648-4647-8fa8-46e850b9167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:05 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (db89525e-bff8-4f80-bc83-744c7a5530c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:05 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-df41d8f8-562e-4e2a-a25e-a87cd65e7e2d tempest-CreateVolumesFromImageTest-1516569272 None] Created volume successfully. Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (3b377034-fb3e-4d3e-b920-fbd104dff1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fd4f95-07ef-4e32-8c4a-4bcb76305610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fd4f95-07ef-4e32-8c4a-4bcb76305610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470299384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d057344a-b92a-497c-a17a-7e5112336fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:06Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74ae9d5-b8ae-41d3-873e-1bede9a06bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b74ae9d5-b8ae-41d3-873e-1bede9a06bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375f7831-15aa-4b39-ad8f-05e985932217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375f7831-15aa-4b39-ad8f-05e985932217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd057344a-b92a-497c-a17a-7e5112336fa9', 'volume_name': 'volume-d057344a-b92a-497c-a17a-7e5112336fa9', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a6472a-5c1b-4726-b3eb-692c6632de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a6472a-5c1b-4726-b3eb-692c6632de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e523a7-49d3-48c2-a544-131d864c495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume d057344a-b92a-497c-a17a-7e5112336fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d057344a-b92a-497c-a17a-7e5112336fa9', 'volume_size': 1} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (58d8f0d6-7d38-4245-bcf4-a01ed56158f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60467d90-417a-4291-a029-9705f5cc250b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60467d90-417a-4291-a029-9705f5cc250b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959693448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac8635e-51e5-495f-834e-089d822d4d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:06Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1f6adb-e251-4755-893a-299a76220860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1f6adb-e251-4755-893a-299a76220860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b34eb2-003c-4250-84ad-fefe120bb44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b34eb2-003c-4250-84ad-fefe120bb44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac8635e-51e5-495f-834e-089d822d4d61', 'volume_name': 'volume-cac8635e-51e5-495f-834e-089d822d4d61', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7e3dca-f2eb-4828-84ec-dee5fd6750cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7e3dca-f2eb-4828-84ec-dee5fd6750cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf545e9-62be-4863-9a32-4c0ac4256983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume cac8635e-51e5-495f-834e-089d822d4d61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac8635e-51e5-495f-834e-089d822d4d61', 'volume_size': 1} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:06 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e 1073741824" returned: 0 in 0.812s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:06 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e Jun 29 03:25:06 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:07 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e" returned: 0 in 0.640s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.101s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1657318869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42c1da4-1c93-4135-a44d-2e26cfb242f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dc59f6fd5ae418bb415b7867ac905f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:24:59Z,use_quota=True,user_id='133c308c92304264b4ecdd60f9778012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Creating volume f42c1da4-1c93-4135-a44d-2e26cfb242f8 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:07 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96208abf-bbad-4be8-afdb-278614e7731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6662f66-4452-4e61-8aaa-d46d2088630e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:07 devstack sudo[113947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 1073741824 Jun 29 03:25:07 devstack sudo[113947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456be228-011b-42fa-b372-c0a873aff9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:07 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Volume volume-e6662f66-4452-4e61-8aaa-d46d2088630e (e6662f66-4452-4e61-8aaa-d46d2088630e): created successfully Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456be228-011b-42fa-b372-c0a873aff9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:07 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (d1a1d335-c020-4c7e-97ed-0d4ded220284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:07 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1da6ec04-8b86-4ff4-b7f1-1152ed551b78 tempest-CreateVolumesFromImageTest-1516569272 None] Created volume successfully. Jun 29 03:25:08 devstack sudo[113947]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 1073741824" returned: 0 in 0.799s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:08 devstack sudo[113953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 Jun 29 03:25:08 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:08 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8" returned: 0 in 0.687s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.502s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-338444940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=becaa754-2524-4e16-805f-c59f7ea7e273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d040994192645dabecba5747a52eae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:02Z,use_quota=True,user_id='3dc8270dfb614993ac4477d80415719c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Creating volume becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:08 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:08 devstack sudo[113956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 1073741824 Jun 29 03:25:08 devstack sudo[113956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdf9085-cf9b-4bcf-bf21-b99fb17609a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f171e7-5010-4ac8-baff-d116d1c9760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:08 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Volume volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 (f42c1da4-1c93-4135-a44d-2e26cfb242f8): created successfully Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81f171e7-5010-4ac8-baff-d116d1c9760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:08 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Flow 'volume_create_manager' (4b385854-fdd2-45a3-803c-1d87f46d295e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f9cb9f61-bbe6-449c-8acd-9fe095c3e12a tempest-CreateVolumesFromImageTest-1516569272 None] Created volume successfully. Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-f42c1da4-1c93-4135-a44d-2e26cfb242f8-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:09 devstack sudo[113956]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 1073741824" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-f42c1da4-1c93-4135-a44d-2e26cfb242f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-quobyte-f42c1da4-1c93-4135-a44d-2e26cfb242f8" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:09 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 Jun 29 03:25:09 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-f42c1da4-1c93-4135-a44d-2e26cfb242f8" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8d003-93ca-49d6-be46-21e354a86150]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:09 devstack sudo[113985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 Jun 29 03:25:09 devstack sudo[113985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:10 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273" returned: 0 in 0.685s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.551s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-447929726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38667b3-c3a4-4c2f-baea-7d2ff642461d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:05Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Creating volume b38667b3-c3a4-4c2f-baea-7d2ff642461d {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:10 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c4567a-e697-4ad6-afb8-7c8ac92cee58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-becaa754-2524-4e16-805f-c59f7ea7e273', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:10 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d 1073741824 Jun 29 03:25:10 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcd9cb7-6478-4924-84e8-63a42679d196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:10 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Volume volume-becaa754-2524-4e16-805f-c59f7ea7e273 (becaa754-2524-4e16-805f-c59f7ea7e273): created successfully Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcd9cb7-6478-4924-84e8-63a42679d196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Flow 'volume_create_manager' (cfd8837e-94e1-474b-ab1d-3d4140ba2004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-9fbf0d67-14a8-4682-8a89-246cc331dc81 tempest-CinderUnicodeTest-424036225 None] Created volume successfully. Jun 29 03:25:10 devstack sudo[113985]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8" returned: 0 in 0.795s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:10 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8 Jun 29 03:25:10 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:11 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f42c1da4-1c93-4135-a44d-2e26cfb242f8" returned: 0 in 0.686s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-f42c1da4-1c93-4135-a44d-2e26cfb242f8" released by "delete_volume" :: held 1.533s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:11 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d 1073741824" returned: 0 in 0.884s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Created reservations ['8b845d97-cdc9-4fb7-8f2e-d329a4e1c4c6', '26d6f14a-e8bd-4ced-88eb-23649d58bf73', 'b0721805-a7c8-4300-960f-4cc169e45fee', '6009c13f-4476-4016-ab19-f2d9d884d0f4'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:11 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d Jun 29 03:25:11 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:11 devstack sudo[114396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:11 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-e6662f66-4452-4e61-8aaa-d46d2088630e-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-e6662f66-4452-4e61-8aaa-d46d2088630e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-quobyte-e6662f66-4452-4e61-8aaa-d46d2088630e" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-e6662f66-4452-4e61-8aaa-d46d2088630e" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7a77c7-967b-41fd-8d40-a0f1945f8cb5]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:12 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d" returned: 0 in 0.668s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.784s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-4358072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea585ac1-139b-4d2b-863b-15410271ac12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:05Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Creating volume ea585ac1-139b-4d2b-863b-15410271ac12 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:12 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f9d50a-d513-46cf-9651-2174aa1a1afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9781fe98-c0a8-4bf7-9478-4518a7d6c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:12 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 1073741824 Jun 29 03:25:12 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:12 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d (b38667b3-c3a4-4c2f-baea-7d2ff642461d): created successfully Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9781fe98-c0a8-4bf7-9478-4518a7d6c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (355eda0d-ac32-463e-9f8e-de58310675e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8911f28a-8fd3-422b-98af-e7b5d00a7df6 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created volume successfully. Jun 29 03:25:12 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e Jun 29 03:25:12 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:12 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.744s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Deleted volume successfully. Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1723953e-4b94-4f4b-bb92-4ef19dbb3b63 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-f42c1da4-1c93-4135-a44d-2e26cfb242f8-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:12 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e" returned: 0 in 0.853s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:12 devstack sudo[114411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e Jun 29 03:25:12 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:12 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 1073741824" returned: 0 in 0.849s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:13 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 Jun 29 03:25:13 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:13 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-e6662f66-4452-4e61-8aaa-d46d2088630e" returned: 0 in 0.615s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-e6662f66-4452-4e61-8aaa-d46d2088630e" released by "delete_volume" :: held 1.518s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Created reservations ['60875029-7a52-4ab7-bc17-72b22e90129f', '61ac16eb-8198-4feb-9151-92049c73c12c', '97d919fd-2d22-4342-8f27-f1814952becf', '657aa5b5-2e06-423a-a4b8-58acef8ec472'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:13 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12" returned: 0 in 0.663s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.212s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc4d2ab-1aea-4a09-b5b1-20274d1da155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb38cc83ddd34dc4b6ca3cd87b4357f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:02Z,use_quota=True,user_id='87b333cf228240c2b50efa04cbc0a2ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(899ad4f3-f5c3-4c35-9827-217aaa097269),volume_type_id=899ad4f3-f5c3-4c35-9827-217aaa097269)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Creating volume 5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:13 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:13 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 1073741824 Jun 29 03:25:13 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fcdc004-1542-4b65-a04d-2daacb1aa26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea585ac1-139b-4d2b-863b-15410271ac12', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18c18f8-cf09-4cc5-9314-f3796a8af83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:13 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume volume-ea585ac1-139b-4d2b-863b-15410271ac12 (ea585ac1-139b-4d2b-863b-15410271ac12): created successfully Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e18c18f8-cf09-4cc5-9314-f3796a8af83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:13 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (b821b8b0-43b1-4274-ab88-60c723933b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:13 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:13 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:13 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a8fc150a-3c37-47f4-ac17-0c2abc9b8b81 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created volume successfully. Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-6f233f25-1fa5-4bb0-8230-c41caf030a7b-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-6f233f25-1fa5-4bb0-8230-c41caf030a7b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-quobyte-6f233f25-1fa5-4bb0-8230-c41caf030a7b" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-6f233f25-1fa5-4bb0-8230-c41caf030a7b" acquired by "delete_volume" :: waited 0.013s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bd063-4ea8-499d-88ee-7d882974de01]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:14 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b Jun 29 03:25:14 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:14 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.719s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:14 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Deleted volume successfully. Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4e04ced0-10a4-4bdd-b6a4-55d96cc6a67c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-e6662f66-4452-4e61-8aaa-d46d2088630e-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:14 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 1073741824" returned: 0 in 0.883s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:14 devstack sudo[114428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:14 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:15 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b" returned: 0 in 0.785s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:15 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b Jun 29 03:25:15 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:15 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 0 in 0.662s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.629s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-929241237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dd35af-9924-4b76-9947-a9b7288130b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:06Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Creating volume d6dd35af-9924-4b76-9947-a9b7288130b0 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:15 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:15 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 1073741824 Jun 29 03:25:15 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Attempting download of 1b675da3-33c3-4d41-be89-8a7e8892444f ((None, [{'url': 'file:///opt/stack/data/glance/images/1b675da3-33c3-4d41-be89-8a7e8892444f', 'metadata': {}}])) to volume 5dc4d2ab-1aea-4a09-b5b1-20274d1da155. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3da2249-c30f-44ee-abab-b635b10b5c7e]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:15 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11 Jun 29 03:25:15 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:15 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6f233f25-1fa5-4bb0-8230-c41caf030a7b" returned: 0 in 0.654s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-6f233f25-1fa5-4bb0-8230-c41caf030a7b" released by "delete_volume" :: held 1.481s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Created reservations ['45952966-c7cd-4579-ab47-d2fc780f8557', '5084b31e-b5f2-47db-893d-b0d552f7f243', 'e7bef75f-b9e5-4a52-9b9d-fcf113cda814', 'a013e279-19a5-4c11-9343-a3bbb5a7ea31'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:15 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:15 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:16 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11" returned: 0 in 0.760s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:16 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 1073741824" returned: 0 in 0.952s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:16 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11 Jun 29 03:25:16 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:16 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 Jun 29 03:25:16 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-657766b0-19ce-45fb-acaf-75a285170c23-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-657766b0-19ce-45fb-acaf-75a285170c23-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-quobyte-657766b0-19ce-45fb-acaf-75a285170c23" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-657766b0-19ce-45fb-acaf-75a285170c23" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d932c8a-79a5-4ccd-a4b6-56b035fdfca4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:16 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.775s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:16 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Deleted volume successfully. Jun 29 03:25:16 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e9196ac2-33d9-4c11-aad5-87417399ac8c tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-6f233f25-1fa5-4bb0-8230-c41caf030a7b-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:16 devstack sudo[114455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 Jun 29 03:25:16 devstack sudo[114455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:17 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11" returned: 1 in 0.837s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1b675da3-33c3-4d41-be89-8a7e8892444f_lp2bf_11' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fbe2dc-b2cc-421f-a35e-03afdccd0b81]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:17 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0" returned: 0 in 0.805s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.004s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-470299384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d057344a-b92a-497c-a17a-7e5112336fa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:06Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Creating volume d057344a-b92a-497c-a17a-7e5112336fa9 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:17 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:17 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD Jun 29 03:25:17 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:17 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 1073741824 Jun 29 03:25:17 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937b2c32-60f3-41fc-966b-b811d532380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dd35af-9924-4b76-9947-a9b7288130b0', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67355e08-c336-4591-8bb6-2981d2ef0d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:17 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume volume-d6dd35af-9924-4b76-9947-a9b7288130b0 (d6dd35af-9924-4b76-9947-a9b7288130b0): created successfully Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67355e08-c336-4591-8bb6-2981d2ef0d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (28829616-85ce-48ac-9863-c45a0815159a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-a0275923-d596-48dc-8d6c-659350860002 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created volume successfully. Jun 29 03:25:17 devstack sudo[114455]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23" returned: 0 in 0.868s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:17 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23 Jun 29 03:25:17 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:17 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:17 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:17 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:17 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD Jun 29 03:25:17 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:18 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 1073741824" returned: 0 in 1.007s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:18 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 Jun 29 03:25:18 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:18 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-657766b0-19ce-45fb-acaf-75a285170c23" returned: 0 in 0.813s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-657766b0-19ce-45fb-acaf-75a285170c23" released by "delete_volume" :: held 1.738s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Created reservations ['e2efc28e-73d5-4fb2-b048-722bd4d32bf7', '18b49a59-dd50-4287-99db-52eb29e17eeb', '15c708a1-fee9-4356-a393-3ff004dac0eb', '2cf230a8-fc64-42b5-be78-2c5eb48d4b18'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:18 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.815s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:18 devstack sudo[114483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:18 devstack sudo[114483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:18 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD" returned: 1 in 0.872s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] 1b675da3-33c3-4d41-be89-8a7e8892444f was raw, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:18 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:18 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-da7e8576-939d-4a7a-93a5-d53ba7cac64d-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-da7e8576-939d-4a7a-93a5-d53ba7cac64d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "cinder-quobyte-da7e8576-939d-4a7a-93a5-d53ba7cac64d" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-da7e8576-939d-4a7a-93a5-d53ba7cac64d" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84fce6e-0d89-445d-aa2f-e483b83697a0]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:19 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9" returned: 0 in 0.811s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] <== create_volume: return (1885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.593s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959693448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac8635e-51e5-495f-834e-089d822d4d61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90066f98164a57b87bc7c455b7a128',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:06Z,use_quota=True,user_id='3909d30df7894e679806f1d3f4e6cd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Creating volume cac8635e-51e5-495f-834e-089d822d4d61 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:19 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:19 devstack sudo[114492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 1073741824 Jun 29 03:25:19 devstack sudo[114492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e523a7-49d3-48c2-a544-131d864c495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d057344a-b92a-497c-a17a-7e5112336fa9', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ad1b20-2031-425c-8e99-929c271d70dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:19 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d Jun 29 03:25:19 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:19 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume volume-d057344a-b92a-497c-a17a-7e5112336fa9 (d057344a-b92a-497c-a17a-7e5112336fa9): created successfully Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ad1b20-2031-425c-8e99-929c271d70dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (3b377034-fb3e-4d3e-b920-fbd104dff1ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7ae77f9a-bc96-43cb-9080-37459c47d4d2 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created volume successfully. Jun 29 03:25:19 devstack sudo[114483]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.835s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:19 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Deleted volume successfully. Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-077d118d-903c-4b3c-a17c-a8f655c81574 tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-657766b0-19ce-45fb-acaf-75a285170c23-delete_volume" released by "delete_volume" :: held 2.813s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:19 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 0 in 0.888s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1b675da3-33c3-4d41-be89-8a7e8892444f_qzsglhwpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:25:19 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:19 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 1G Jun 29 03:25:19 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:19 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d" returned: 0 in 0.881s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:19 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d Jun 29 03:25:19 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:20 devstack sudo[114492]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 1073741824" returned: 0 in 1.034s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:20 devstack sudo[114516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 Jun 29 03:25:20 devstack sudo[114516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:20 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 1G" returned: 0 in 0.718s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab16ab2-029c-45ed-8fcc-cecabd1cd644]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:20 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:20 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:20 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-da7e8576-939d-4a7a-93a5-d53ba7cac64d" returned: 0 in 0.731s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-quobyte-da7e8576-939d-4a7a-93a5-d53ba7cac64d" released by "delete_volume" :: held 1.671s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Created reservations ['c3a21d24-7275-4c99-9638-c3e2f69a9ba8', 'e410d072-b641-4ef8-a907-c16090e734d6', '1c27cf9d-5706-421a-a2a2-c1e43d06d9e6', '213e7777-7ad5-44c5-a120-4a2d22ab02aa'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:20 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:20 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:20 devstack sudo[114516]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61" returned: 0 in 0.696s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.728s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Creating offline snapshot 5c916332-2ec8-470a-896b-7e6d2d5caec2 of volume becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf545e9-62be-4863-9a32-4c0ac4256983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac8635e-51e5-495f-834e-089d822d4d61', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26fe2c4-50cc-46a1-b3e4-a54e13f03179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5afe06-594a-499f-a4c2-e7b9ed263d1f]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:20 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Volume volume-cac8635e-51e5-495f-834e-089d822d4d61 (cac8635e-51e5-495f-834e-089d822d4d61): created successfully Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b26fe2c4-50cc-46a1-b3e4-a54e13f03179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:20 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Flow 'volume_create_manager' (58d8f0d6-7d38-4245-bcf4-a01ed56158f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-5be40b9d-9551-4921-a634-8d52b48ea896 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created volume successfully. Jun 29 03:25:20 devstack sudo[114528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 Jun 29 03:25:20 devstack sudo[114528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:21 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 0 in 0.791s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:21 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:21 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:21 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.685s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:21 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Deleted volume successfully. Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-66fd1dad-515d-4e69-a218-93b3892d476e tempest-CreateVolumesFromImageTest-1516569272 None] Lock "cinder-da7e8576-939d-4a7a-93a5-d53ba7cac64d-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-cac8635e-51e5-495f-834e-089d822d4d61-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-cac8635e-51e5-495f-834e-089d822d4d61-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-quobyte-cac8635e-51e5-495f-834e-089d822d4d61" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-cac8635e-51e5-495f-834e-089d822d4d61" acquired by "delete_volume" :: waited 0.034s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdbb5f0-c638-4956-84e5-2ae3fe1dd49c]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:21 devstack sudo[114528]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273" returned: 0 in 1.018s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:21 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:21 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 1G Jun 29 03:25:21 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:21 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 Jun 29 03:25:21 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:22 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 1 in 1.077s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Downloaded image 1b675da3-33c3-4d41-be89-8a7e8892444f ((None, [{'url': 'file:///opt/stack/data/glance/images/1b675da3-33c3-4d41-be89-8a7e8892444f', 'metadata': {}}])) to volume 5dc4d2ab-1aea-4a09-b5b1-20274d1da155 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Temporary image 1b675da3-33c3-4d41-be89-8a7e8892444f for user 87b333cf228240c2b50efa04cbc0a2ef is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Marking volume 5dc4d2ab-1aea-4a09-b5b1-20274d1da155 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Copying metadata from image 1b675da3-33c3-4d41-be89-8a7e8892444f to 5dc4d2ab-1aea-4a09-b5b1-20274d1da155. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Creating volume glance metadata for volume 5dc4d2ab-1aea-4a09-b5b1-20274d1da155 backed by image 1b675da3-33c3-4d41-be89-8a7e8892444f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '7d57f66028d4fc497a8a419c70ba9cb2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d707aea-eac2-4c35-840e-5ba81e0d7a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155', 'volume_size': 1, 'image_id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1b675da3-33c3-4d41-be89-8a7e8892444f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7d57f66028d4fc497a8a419c70ba9cb2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb38cc83ddd34dc4b6ca3cd87b4357f8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3655efeca343fb6404ff57d8d3d4da2aa5d1a5f3b8bb5b8ca30550297cede237b18cd44f2bf14545f42537f83933bbb57897887aa5de47bbf50328b91629d18', 'id': '1b675da3-33c3-4d41-be89-8a7e8892444f', 'created_at': datetime.datetime(2026, 6, 29, 1, 24, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 25, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1b675da3-33c3-4d41-be89-8a7e8892444f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c5f2e2-ebbc-4dae-9d0e-b3eaaa0a7966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:22 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Volume volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 (5dc4d2ab-1aea-4a09-b5b1-20274d1da155): created successfully Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64c5f2e2-ebbc-4dae-9d0e-b3eaaa0a7966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Flow 'volume_create_manager' (57914e13-e8a0-49c2-877d-96948e2cd410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:22 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ae4ab51e-3715-4acd-835c-e873005e2d3f tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Created volume successfully. Jun 29 03:25:22 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61" returned: 0 in 0.919s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:22 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61 Jun 29 03:25:22 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:22 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 1G" returned: 0 in 1.077s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:22 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becaa754-2524-4e16-805f-c59f7ea7e273 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:22 devstack sudo[114555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becaa754-2524-4e16-805f-c59f7ea7e273 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 Jun 29 03:25:22 devstack sudo[114555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Acquiring lock "cinder-5dc4d2ab-1aea-4a09-b5b1-20274d1da155-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "cinder-5dc4d2ab-1aea-4a09-b5b1-20274d1da155-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Acquiring lock "cinder-quobyte-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "cinder-quobyte-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfd247c-900b-43e3-8013-86cf315ef4a9]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:23 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:23 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:23 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-cac8635e-51e5-495f-834e-089d822d4d61" returned: 0 in 0.869s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-cac8635e-51e5-495f-834e-089d822d4d61" released by "delete_volume" :: held 1.863s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created reservations ['408453c0-be12-4f9f-b0ea-896d6de1159d', '84db5773-4127-4373-b022-44badb81ebfa', 'fa6a55e9-55bf-4bb4-80f5-746d187b6525', 'f21d0a91-eaaa-4bbb-a686-8081a72dac32'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:23 devstack sudo[114555]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-becaa754-2524-4e16-805f-c59f7ea7e273 -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2" returned: 0 in 0.818s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:23 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 is being set with open permissions: ugo+rw Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:23 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 Jun 29 03:25:23 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:23 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:23 devstack sudo[114568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:23 devstack sudo[114568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-d057344a-b92a-497c-a17a-7e5112336fa9-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-d057344a-b92a-497c-a17a-7e5112336fa9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-quobyte-d057344a-b92a-497c-a17a-7e5112336fa9" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-d057344a-b92a-497c-a17a-7e5112336fa9" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca38ffff-99b3-4f77-a7a4-c6cbfd8f9763]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:24 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 0 in 1.043s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:24 devstack sudo[114572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 Jun 29 03:25:24 devstack sudo[114572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:24 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:24 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:24 devstack sudo[114568]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.034s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:24 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2" returned: 0 in 1.100s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:24 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Deleted volume successfully. Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-e8a29ccf-95ba-4691-b1f2-9c520dee66ba tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-cac8635e-51e5-495f-834e-089d822d4d61-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:24 devstack sudo[114578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info Jun 29 03:25:24 devstack sudo[114578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (280e21ba-4f66-402c-8753-17f9e63a2280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eb6b52-62cf-47eb-8ee9-a47d7137a53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:24 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59eb6b52-62cf-47eb-8ee9-a47d7137a53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817219215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d96342-178e-40a5-8bc2-8e1c7507ad5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:25Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d1cc23-ae46-4cd2-9954-201f5a133d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d1cc23-ae46-4cd2-9954-201f5a133d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94da2f-1dc3-4524-9d14-01dbc21014d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab94da2f-1dc3-4524-9d14-01dbc21014d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6d96342-178e-40a5-8bc2-8e1c7507ad5d', 'volume_name': 'volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da38269-fabd-4c58-8350-fdf477492eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da38269-fabd-4c58-8350-fdf477492eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae96977-a999-4874-90f5-2cd078f26332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:25 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume f6d96342-178e-40a5-8bc2-8e1c7507ad5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d', 'volume_size': 1} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:25 devstack sudo[114572]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9" returned: 0 in 1.047s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:25 devstack sudo[114586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9 Jun 29 03:25:25 devstack sudo[114586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:25 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 1 in 1.041s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:25 devstack sudo[114588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155 Jun 29 03:25:25 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:25 devstack sudo[114578]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info" returned: 0 in 0.762s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:25 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info is being set with open permissions: ugo+rw Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:25 devstack sudo[114591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info Jun 29 03:25:25 devstack sudo[114591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:25 devstack sudo[114586]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d057344a-b92a-497c-a17a-7e5112336fa9" returned: 0 in 0.671s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-d057344a-b92a-497c-a17a-7e5112336fa9" released by "delete_volume" :: held 1.787s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created reservations ['66586f52-5b63-432a-84fc-86a1bd9e1ad2', '2c32a45d-5b50-4a15-8142-17290135f5df', '84f9368e-2dbc-4962-bed3-594e59b1e66b', 'ca93df24-5882-4913-b271-a0ebc156d6ac'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:25 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" returned: 0 in 0.659s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "cinder-quobyte-5dc4d2ab-1aea-4a09-b5b1-20274d1da155" released by "delete_volume" :: held 2.832s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Created reservations ['8c6ba3e4-055b-4832-b784-9a38297b5ac5', '544ccf60-dd2e-4352-b317-f21941e973c0', '00799605-fa40-43a3-8060-d17d3fdeef8f', '3c11bab4-ab95-4c94-8c94-8fc35e248de4'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:26 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:26 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:26 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:26 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-d6dd35af-9924-4b76-9947-a9b7288130b0-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-d6dd35af-9924-4b76-9947-a9b7288130b0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:26 devstack sudo[114591]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.info" returned: 0 in 0.761s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.672s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-817219215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6d96342-178e-40a5-8bc2-8e1c7507ad5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:25Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating volume f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:26 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-quobyte-d6dd35af-9924-4b76-9947-a9b7288130b0" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:26 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d 1073741824 Jun 29 03:25:26 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-d6dd35af-9924-4b76-9947-a9b7288130b0" acquired by "delete_volume" :: waited 0.029s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e6cc2f0d-cd20-41f0-9b14-a6081f59ab1d tempest-CinderUnicodeTest-424036225 None] Create snapshot completed successfully Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bba1215-7bc4-482d-8e7f-ac2988f88678]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:26 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 Jun 29 03:25:26 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-5c916332-2ec8-470a-896b-7e6d2d5caec2-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-5c916332-2ec8-470a-896b-7e6d2d5caec2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-quobyte-becaa754-2524-4e16-805f-c59f7ea7e273" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-becaa754-2524-4e16-805f-c59f7ea7e273" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-quobyte-5c916332-2ec8-470a-896b-7e6d2d5caec2" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-5c916332-2ec8-470a-896b-7e6d2d5caec2" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Deleting offline snapshot 5c916332-2ec8-470a-896b-7e6d2d5caec2 of volume becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:25:27 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] snapshot_file for this snap is: volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.042s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Deleted volume successfully. Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[994212df-8a8b-4569-9af9-5f534e2a2774]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-aece1e27-cd09-4bc7-b8c1-3d69a10f5370 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-d057344a-b92a-497c-a17a-7e5112336fa9-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:27 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 Jun 29 03:25:27 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:27 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.202s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:27 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Deleted volume successfully. Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d615d657-ba83-436d-a8bf-f996c0d8a80a tempest-VolumeAndVolumeTypeFromImageTest-1933984921 None] Lock "cinder-5dc4d2ab-1aea-4a09-b5b1-20274d1da155-delete_volume" released by "delete_volume" :: held 4.317s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:27 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d 1073741824" returned: 0 in 1.113s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:27 devstack sudo[114616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d Jun 29 03:25:27 devstack sudo[114616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:27 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0" returned: 0 in 1.294s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:27 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0 Jun 29 03:25:27 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:28 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2" returned: 0 in 1.006s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-becaa754-2524-4e16-805f-c59f7ea7e273(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a250a106-4f9b-44df-ad6b-2f00b451f24d]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:28 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 Jun 29 03:25:28 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:28 devstack sudo[114616]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" returned: 0 in 0.781s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cae96977-a999-4874-90f5-2cd078f26332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2439251-d1cd-475c-863e-8e3c465144d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:28 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d (f6d96342-178e-40a5-8bc2-8e1c7507ad5d): created successfully Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2439251-d1cd-475c-863e-8e3c465144d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (280e21ba-4f66-402c-8753-17f9e63a2280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:28 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ec95051d-9837-42df-b007-1c28a57cd273 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created volume successfully. Jun 29 03:25:28 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-d6dd35af-9924-4b76-9947-a9b7288130b0" returned: 0 in 0.838s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-d6dd35af-9924-4b76-9947-a9b7288130b0" released by "delete_volume" :: held 2.207s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created reservations ['81e43243-5dc7-4347-85f9-6dae5178686a', '1f6c6fd4-5a7b-4d95-947b-075b0936ce5c', 'd25af844-389a-4354-9a09-103342f0c3e2', '3fd0cb3c-2134-41d0-84e6-cec0a7adb0c5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:28 devstack sudo[114628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:28 devstack sudo[114628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:29 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273" returned: 0 in 0.893s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:29 devstack sudo[114632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 Jun 29 03:25:29 devstack sudo[114632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating offline snapshot ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead of volume f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c9e044-3aa4-497e-9ec7-ae7446d40d66]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:29 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d Jun 29 03:25:29 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-ea585ac1-139b-4d2b-863b-15410271ac12-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-ea585ac1-139b-4d2b-863b-15410271ac12-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:29 devstack sudo[114628]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.991s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:29 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Deleted volume successfully. Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-2407b6d2-34f8-4c77-8418-f579670d6b06 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-d6dd35af-9924-4b76-9947-a9b7288130b0-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-quobyte-ea585ac1-139b-4d2b-863b-15410271ac12" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:29 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-ea585ac1-139b-4d2b-863b-15410271ac12" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f65ec0f-539d-4624-a655-a1b2d8789d06]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:30 devstack sudo[114632]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2" returned: 0 in 1.008s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:30 devstack sudo[114641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2 Jun 29 03:25:30 devstack sudo[114641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:30 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 Jun 29 03:25:30 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:30 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" returned: 0 in 1.047s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:30 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead 1G Jun 29 03:25:30 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:30 devstack sudo[114641]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273.5c916332-2ec8-470a-896b-7e6d2d5caec2" returned: 0 in 0.820s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12" returned: 0 in 0.951s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-5c916332-2ec8-470a-896b-7e6d2d5caec2" released by "_delete_snapshot" :: held 3.917s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-becaa754-2524-4e16-805f-c59f7ea7e273" released by "delete_snapshot" :: held 3.967s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12 Jun 29 03:25:31 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Created reservations ['58b51dde-5063-4272-87b1-e3f1fbc1741b', '4b6f6c73-f366-400c-8e2b-328394b6c2a1', '76c976e4-be6c-478b-a4bb-5992c948cdc9', '21b9db05-7750-49d8-a4ac-1f860b17e5d4'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:31 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Delete snapshot completed successfully. Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-860767fa-6e2f-49f5-8403-a4f0fdf149c6 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-5c916332-2ec8-470a-896b-7e6d2d5caec2-delete_snapshot" released by "delete_snapshot" :: held 4.201s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-becaa754-2524-4e16-805f-c59f7ea7e273-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Lock "cinder-becaa754-2524-4e16-805f-c59f7ea7e273-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-quobyte-becaa754-2524-4e16-805f-c59f7ea7e273" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-becaa754-2524-4e16-805f-c59f7ea7e273" acquired by "delete_volume" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8140c94d-170b-4001-a457-a710d91f6bfd]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:31 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead 1G" returned: 0 in 1.028s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:31 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 Jun 29 03:25:31 devstack sudo[114660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead Jun 29 03:25:31 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:31 devstack sudo[114660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:31 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ea585ac1-139b-4d2b-863b-15410271ac12" returned: 0 in 0.817s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-ea585ac1-139b-4d2b-863b-15410271ac12" released by "delete_volume" :: held 1.839s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created reservations ['c496b95f-9cc1-474d-8dae-d2ca71e8ad7d', '07dde024-b777-4033-a5a6-3fa65a824cd5', 'dc6aead9-b96f-4878-ba8b-2b07338edcbb', '5abe3966-e806-4a7f-bf45-bcd24e3c1594'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:31 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:31 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-b38667b3-c3a4-4c2f-baea-7d2ff642461d-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-b38667b3-c3a4-4c2f-baea-7d2ff642461d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-quobyte-b38667b3-c3a4-4c2f-baea-7d2ff642461d" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-b38667b3-c3a4-4c2f-baea-7d2ff642461d" acquired by "delete_volume" :: waited 0.022s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92d817b-1d73-430c-adba-dd614f95cf1e]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:32 devstack sudo[114673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d Jun 29 03:25:32 devstack sudo[114673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:32 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273" returned: 0 in 1.135s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:32 devstack sudo[114660]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" returned: 0 in 1.054s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:32 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead is being set with open permissions: ugo+rw Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:32 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273 Jun 29 03:25:32 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:32 devstack sudo[114677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead Jun 29 03:25:32 devstack sudo[114677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:32 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.024s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:32 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:32 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Deleted volume successfully. Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-3c167e3e-5e75-434f-a573-ad113bda3e97 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-ea585ac1-139b-4d2b-863b-15410271ac12-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:33 devstack sudo[114673]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d" returned: 0 in 1.009s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:33 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-becaa754-2524-4e16-805f-c59f7ea7e273" returned: 0 in 0.839s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:33 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d Jun 29 03:25:33 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-becaa754-2524-4e16-805f-c59f7ea7e273" released by "delete_volume" :: held 2.053s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Created reservations ['151b8184-ea5e-4ddc-b113-bcf3b2860fd0', '6a7f1dd3-3bf4-46a8-b782-3b92a5113e26', '6b0f53af-0dff-46cf-ab1e-a93fc8ba1d26', '61b6c0c3-93e5-45fc-a81a-eb9a6140c324'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:33 devstack sudo[114677]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" returned: 0 in 0.909s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:33 devstack sudo[114687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info Jun 29 03:25:33 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:33 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:33 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-6cfb5333-4b72-43a8-8a04-360b1f39b22e-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-6cfb5333-4b72-43a8-8a04-360b1f39b22e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "cinder-quobyte-6cfb5333-4b72-43a8-8a04-360b1f39b22e" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-6cfb5333-4b72-43a8-8a04-360b1f39b22e" acquired by "delete_volume" :: waited 0.025s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce93d93-ab66-49c2-956e-0dd5285f0688]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:33 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e Jun 29 03:25:33 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:34 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-b38667b3-c3a4-4c2f-baea-7d2ff642461d" returned: 0 in 0.838s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-b38667b3-c3a4-4c2f-baea-7d2ff642461d" released by "delete_volume" :: held 1.942s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created reservations ['6d5c6ab2-672c-49df-83da-bda2bb849fdf', 'aee2f957-329d-4784-8ce6-fdb6b04871d7', '1b733b4f-5c92-42b5-8f9f-09c8a298e8e8', '7e7fb7b7-921c-4766-a8ca-ae470a67c462'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:34 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info" returned: 0 in 0.872s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:34 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info is being set with open permissions: ugo+rw Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:34 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info Jun 29 03:25:34 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:34 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:34 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-ef11f5c2-faab-4407-bba7-6b817f2a34b8-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-ef11f5c2-faab-4407-bba7-6b817f2a34b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "cinder-quobyte-ef11f5c2-faab-4407-bba7-6b817f2a34b8" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-ef11f5c2-faab-4407-bba7-6b817f2a34b8" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:34 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.047s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:34 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Deleted volume successfully. Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b73982-7255-41cf-94fa-a563378a8a29]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:34 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-661cb7e3-f59f-4410-813d-1756598c21da tempest-CinderUnicodeTest-424036225 None] Lock "cinder-becaa754-2524-4e16-805f-c59f7ea7e273-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:34 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 Jun 29 03:25:34 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:34 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e" returned: 0 in 1.151s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:35 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e Jun 29 03:25:35 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:35 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.info" returned: 0 in 0.938s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.002s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:35 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.009s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Deleted volume successfully. Jun 29 03:25:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-eb57eb25-f4d2-49c2-ab4a-2e5837a29f98 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Create snapshot completed successfully Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ffcf08d9-3e43-454f-ab05-c2af1f850b60 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-b38667b3-c3a4-4c2f-baea-7d2ff642461d-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:35 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8" returned: 0 in 1.051s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:35 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8 Jun 29 03:25:35 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:35 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-6cfb5333-4b72-43a8-8a04-360b1f39b22e" returned: 0 in 0.863s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-quobyte-6cfb5333-4b72-43a8-8a04-360b1f39b22e" released by "delete_volume" :: held 2.076s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Created reservations ['2a55e4f2-fb95-4870-b3b2-e57f3314c832', 'd8d93576-dae4-4b8d-b800-17691c4b3e81', '9287bf36-a226-44a8-a75e-52764d8fc877', '31e6186f-c63d-4f64-8d60-9a498cc0ba51'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:36 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:36 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:36 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-ef11f5c2-faab-4407-bba7-6b817f2a34b8" returned: 0 in 0.852s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-quobyte-ef11f5c2-faab-4407-bba7-6b817f2a34b8" released by "delete_volume" :: held 2.000s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Created reservations ['9d728c66-87f6-446b-9f3c-0b14db89df50', '8f5cdef6-7efd-4c37-be2f-6d7081b49bab', 'c66bdb66-3179-44fd-8848-a1c18ffbb92c', '62800e53-f1ce-4a0c-b41c-373ae505c140'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:36 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:36 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Flow 'volume_create_manager' (8cad64b9-249c-40af-9929-c8288cce68e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:36 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfb2217-cfe6-401f-9fd6-f29245a09d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfb2217-cfe6-401f-9fd6-f29245a09d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0244577-6b66-4aca-b3e0-70f2fdaa2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09afbbe74f4147298b6b182eff20816e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:37Z,use_quota=True,user_id='43234a31939f4b91bfb6b47c34cb1c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344edc57-a607-4c82-a9fd-1c55180de634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (344edc57-a607-4c82-a9fd-1c55180de634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb645e9f-56f6-44c3-bbb5-0397344610e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.image.glance [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Creating Keystone auth plugin from conf {{(pid=93518) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 29 03:25:37 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.217s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:37 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Deleted volume successfully. Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-436e6943-d7e3-40aa-9656-50e0c1bb4443 tempest-CinderUnicodeTest-424036225 None] Lock "cinder-6cfb5333-4b72-43a8-8a04-360b1f39b22e-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (e79171b3-d0e1-4358-b666-7dd930ffbace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa92f4d-fd04-49a6-ad6b-321dbe2e3399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fa92f4d-fd04-49a6-ad6b-321dbe2e3399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342576848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386056d8-12b7-4498-9ece-673c9578041e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:37Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c138ca11-3626-490c-b3a5-9b3c91cb842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c138ca11-3626-490c-b3a5-9b3c91cb842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284f9a2d-c8a9-4ef4-9067-0372fc91ae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284f9a2d-c8a9-4ef4-9067-0372fc91ae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386056d8-12b7-4498-9ece-673c9578041e', 'volume_name': 'volume-386056d8-12b7-4498-9ece-673c9578041e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2694682e-4fb7-4fca-9937-87237e22ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2694682e-4fb7-4fca-9937-87237e22ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49b5c62-dd30-4f19-864e-c750cefcbdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume 386056d8-12b7-4498-9ece-673c9578041e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386056d8-12b7-4498-9ece-673c9578041e', 'volume_size': 1} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1342576848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386056d8-12b7-4498-9ece-673c9578041e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:37Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating volume 386056d8-12b7-4498-9ece-673c9578041e {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:37 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:37 devstack sudo[114722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e 1073741824 Jun 29 03:25:37 devstack sudo[114722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (1fe64dc1-5bee-47dc-9a5c-f4465a453c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4395ac8-27a2-40cc-a6af-3b5193ad02c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4395ac8-27a2-40cc-a6af-3b5193ad02c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530630576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d217ca7-3219-450b-8ab0-6d9709ff6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:37Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab1354c-a864-44b8-ad3b-71cd6348ef3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab1354c-a864-44b8-ad3b-71cd6348ef3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414883e9-19fb-4375-b7a4-17692e388f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414883e9-19fb-4375-b7a4-17692e388f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d217ca7-3219-450b-8ab0-6d9709ff6542', 'volume_name': 'volume-4d217ca7-3219-450b-8ab0-6d9709ff6542', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f55c4b-8f05-4364-a6f3-f30fe110e71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:37 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f55c4b-8f05-4364-a6f3-f30fe110e71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545f62e2-e95a-43c3-9e92-218ff1765575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume 4d217ca7-3219-450b-8ab0-6d9709ff6542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d217ca7-3219-450b-8ab0-6d9709ff6542', 'volume_size': 1} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.157s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:38 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Deleted volume successfully. Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (1bd11ba8-7ac5-433e-8f79-d924e39797f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e514e2-6938-467b-a3df-2491ccddc9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-6a87a43f-12b1-4d95-817a-082386c201b7 tempest-CreateVolumesFromSourceVolumeTest-2086308053 None] Lock "cinder-ef11f5c2-faab-4407-bba7-6b817f2a34b8-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3e514e2-6938-467b-a3df-2491ccddc9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792974746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f89b43-ef37-4b19-8dcb-699a596d1cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:38Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a66fec7-5d9d-46de-83b8-ba1bd292ea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a66fec7-5d9d-46de-83b8-ba1bd292ea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b930d2e3-bac8-4c43-8bff-6d24300c9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b930d2e3-bac8-4c43-8bff-6d24300c9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f89b43-ef37-4b19-8dcb-699a596d1cbb', 'volume_name': 'volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce323a80-72f7-47cd-a2e7-79136824d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce323a80-72f7-47cd-a2e7-79136824d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd14866-3aa9-4913-acf9-4cc529514ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume 28f89b43-ef37-4b19-8dcb-699a596d1cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb', 'volume_size': 1} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (1245dab1-c2bf-41c7-b567-10ecac482cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71d41bc-3a89-4e6f-b454-66d6d41762a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71d41bc-3a89-4e6f-b454-66d6d41762a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219451003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49753997-d33c-47f8-8468-75eb6ffca6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:38Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560f69c2-f3a5-4963-b7a0-4ac993c607ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560f69c2-f3a5-4963-b7a0-4ac993c607ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4f4347-bc60-412c-a7e1-ce9ba01f46cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4f4347-bc60-412c-a7e1-ce9ba01f46cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49753997-d33c-47f8-8468-75eb6ffca6a2', 'volume_name': 'volume-49753997-d33c-47f8-8468-75eb6ffca6a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8c6efe-cc93-4221-bc5d-255d0f51b5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8c6efe-cc93-4221-bc5d-255d0f51b5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6718d3e3-e6d7-4da4-af91-e78d00487cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume 49753997-d33c-47f8-8468-75eb6ffca6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49753997-d33c-47f8-8468-75eb6ffca6a2', 'volume_size': 1} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb645e9f-56f6-44c3-bbb5-0397344610e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0244577-6b66-4aca-b3e0-70f2fdaa2581', 'volume_name': 'volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581', 'volume_size': 1, 'image_id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e2d2e0fece7b9fd27259dfdcf513b00', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09afbbe74f4147298b6b182eff20816e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15894ed6753dbc9ae2a38d7c15c9f7a0fa0ca4cf4b1d9290854cf94a08c18155b2e5bb35d337b07a0955379795a304eb4a14afb1120c26af9834a52b496e8445', 'id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'created_at': datetime.datetime(2026, 6, 29, 1, 25, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 25, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff/file', 'properties': {}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1282af5e-20a8-4afc-8a0c-962dc32d2e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1282af5e-20a8-4afc-8a0c-962dc32d2e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52f77f9-a082-4c93-9c16-daa977e0b921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:38 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Volume c0244577-6b66-4aca-b3e0-70f2fdaa2581: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581', 'volume_size': 1, 'image_id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e2d2e0fece7b9fd27259dfdcf513b00', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09afbbe74f4147298b6b182eff20816e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15894ed6753dbc9ae2a38d7c15c9f7a0fa0ca4cf4b1d9290854cf94a08c18155b2e5bb35d337b07a0955379795a304eb4a14afb1120c26af9834a52b496e8445', 'id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'created_at': datetime.datetime(2026, 6, 29, 1, 25, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 25, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff/file', 'properties': {}}, 'image_service': } Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Trying to clone c0244577-6b66-4aca-b3e0-70f2fdaa2581 from image 12b2e6f6-f41b-49ca-b031-981dd81e55ff at location (None, [{'url': 'file:///opt/stack/data/glance/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'metadata': {}}]). {{(pid=93518) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 29 03:25:38 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Image download 0.00 MB at 0.00 MB/s Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f5906-2d66-4a94-8eba-95648195e341]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:38 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (d1de3c0b-f022-46e3-98da-a0935887df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec433a-f330-4117-9ba7-3f897c99d524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ec433a-f330-4117-9ba7-3f897c99d524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1144870031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219c358d-c219-4806-aee0-63cc7993f75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:39Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1385f0d-356a-4fb0-96c0-9868ecb93951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1385f0d-356a-4fb0-96c0-9868ecb93951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7bc4b8-4aa9-4c9e-b4d0-2337ec01be97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e7bc4b8-4aa9-4c9e-b4d0-2337ec01be97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '219c358d-c219-4806-aee0-63cc7993f75c', 'volume_name': 'volume-219c358d-c219-4806-aee0-63cc7993f75c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4be281-6872-4e16-8fe8-8d9d45a4a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f4be281-6872-4e16-8fe8-8d9d45a4a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af74555e-a191-4f82-85ec-e6c860c4e753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:39 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume 219c358d-c219-4806-aee0-63cc7993f75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-219c358d-c219-4806-aee0-63cc7993f75c', 'volume_size': 1} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:39 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD Jun 29 03:25:39 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:39 devstack sudo[114722]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e 1073741824" returned: 0 in 1.505s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:39 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:39 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e Jun 29 03:25:39 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:40 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD" returned: 0 in 1.131s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:40 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e" returned: 0 in 0.813s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.034s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-530630576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d217ca7-3219-450b-8ab0-6d9709ff6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:37Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating volume 4d217ca7-3219-450b-8ab0-6d9709ff6542 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:40 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c49b5c62-dd30-4f19-864e-c750cefcbdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386056d8-12b7-4498-9ece-673c9578041e', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:40 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 1073741824 Jun 29 03:25:40 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a59eb61-b2a7-4c8e-9e92-477c320edbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:40 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume volume-386056d8-12b7-4498-9ece-673c9578041e (386056d8-12b7-4498-9ece-673c9578041e): created successfully Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a59eb61-b2a7-4c8e-9e92-477c320edbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:40 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD Jun 29 03:25:40 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (e79171b3-d0e1-4358-b666-7dd930ffbace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:40 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f8e7f4e8-afef-4b68-91c0-00e267332f34 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created volume successfully. Jun 29 03:25:40 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD" returned: 1 in 0.858s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Temporary image 12b2e6f6-f41b-49ca-b031-981dd81e55ff is fetched for user 43234a31939f4b91bfb6b47c34cb1c17. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cecda91-9e4a-4dab-9853-2dccde9685f3]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:40 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:41 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD Jun 29 03:25:41 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:41 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 1073741824" returned: 0 in 1.230s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:41 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:41 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 Jun 29 03:25:41 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:42 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD" returned: 0 in 1.133s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Flow 'volume_create_manager' (3c102d82-e44c-42da-bee0-54e661dc1439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eab962-cb40-493e-b477-90ca1602d502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542" returned: 0 in 0.913s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] <== create_volume: return (2199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.980s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-792974746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f89b43-ef37-4b19-8dcb-699a596d1cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:38Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating volume 28f89b43-ef37-4b19-8dcb-699a596d1cbb {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:42 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:42 devstack sudo[114754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD Jun 29 03:25:42 devstack sudo[114754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eab962-cb40-493e-b477-90ca1602d502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-56718155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4637ee3f-32c5-494c-ae82-a03167e3362c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a942f803ea34a2cae38556cf47b1aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:42Z,use_quota=True,user_id='34097c263a7d409fbce0b44e24739411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528ea073-dd07-4de9-94ec-eba271146c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (528ea073-dd07-4de9-94ec-eba271146c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack sudo[114755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb 1073741824 Jun 29 03:25:42 devstack sudo[114755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba7631-27b9-4017-837d-e12e5c9df704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba7631-27b9-4017-837d-e12e5c9df704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4637ee3f-32c5-494c-ae82-a03167e3362c', 'volume_name': 'volume-4637ee3f-32c5-494c-ae82-a03167e3362c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d916ca1f-9dea-4323-a972-8fd813315d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d916ca1f-9dea-4323-a972-8fd813315d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f10cd5b-fbba-4bab-9ddd-8df4f864b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Volume 4637ee3f-32c5-494c-ae82-a03167e3362c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4637ee3f-32c5-494c-ae82-a03167e3362c', 'volume_size': 1} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (545f62e2-e95a-43c3-9e92-218ff1765575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d217ca7-3219-450b-8ab0-6d9709ff6542', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93818df-b6f5-4e18-8186-cf94b89ed048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:42 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 (4d217ca7-3219-450b-8ab0-6d9709ff6542): created successfully Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93818df-b6f5-4e18-8186-cf94b89ed048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (1fe64dc1-5bee-47dc-9a5c-f4465a453c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:42 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-00d2287e-4307-45dd-8f85-2348836d09b8 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created volume successfully. Jun 29 03:25:42 devstack sudo[114754]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD" returned: 1 in 0.869s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:42 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:43 devstack sudo[114755]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb 1073741824" returned: 0 in 0.967s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:43 devstack sudo[114764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb Jun 29 03:25:43 devstack sudo[114764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:43 devstack sudo[114764]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb" returned: 0 in 0.703s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.419s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1219451003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49753997-d33c-47f8-8468-75eb6ffca6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:38Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating volume 49753997-d33c-47f8-8468-75eb6ffca6a2 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:43 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:43 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:44 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 1073741824 Jun 29 03:25:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd14866-3aa9-4913-acf9-4cc529514ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:44 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b62c35-dc47-418b-8a1d-a5d4ee132c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:44 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb (28f89b43-ef37-4b19-8dcb-699a596d1cbb): created successfully Jun 29 03:25:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b62c35-dc47-418b-8a1d-a5d4ee132c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:44 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (1bd11ba8-7ac5-433e-8f79-d924e39797f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:44 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8d67a6a9-1abc-4002-bcd1-fff99743d701 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created volume successfully. Jun 29 03:25:44 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 1073741824" returned: 0 in 0.953s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:44 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:45 devstack sudo[114809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 Jun 29 03:25:45 devstack sudo[114809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2" returned: 0 in 0.650s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:45 devstack sudo[114809]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.530s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1144870031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=219c358d-c219-4806-aee0-63cc7993f75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b53990ac7e44fd4a5e6d59a3d270083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:39Z,use_quota=True,user_id='72e7fe3826d347efb7de4a3dd678e5eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Creating volume 219c358d-c219-4806-aee0-63cc7993f75c {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:45 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:45 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c 1073741824 Jun 29 03:25:45 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6718d3e3-e6d7-4da4-af91-e78d00487cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49753997-d33c-47f8-8468-75eb6ffca6a2', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe01baf9-d395-48ab-9c4b-ecc3b3ac700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:45 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume volume-49753997-d33c-47f8-8468-75eb6ffca6a2 (49753997-d33c-47f8-8468-75eb6ffca6a2): created successfully Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe01baf9-d395-48ab-9c4b-ecc3b3ac700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:45 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (1245dab1-c2bf-41c7-b567-10ecac482cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:45 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7bf6b89d-bf6e-4902-a117-5e636030b8e0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created volume successfully. Jun 29 03:25:46 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c 1073741824" returned: 0 in 1.054s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:46 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:46 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c Jun 29 03:25:46 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:47 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.171s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-56718155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4637ee3f-32c5-494c-ae82-a03167e3362c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a942f803ea34a2cae38556cf47b1aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:42Z,use_quota=True,user_id='34097c263a7d409fbce0b44e24739411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Creating volume 4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:47 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af74555e-a191-4f82-85ec-e6c860c4e753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-219c358d-c219-4806-aee0-63cc7993f75c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:47 devstack sudo[114821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c 1073741824 Jun 29 03:25:47 devstack sudo[114821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294727b2-a48c-4a3a-8619-47d784ae88c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:47 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Volume volume-219c358d-c219-4806-aee0-63cc7993f75c (219c358d-c219-4806-aee0-63cc7993f75c): created successfully Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (294727b2-a48c-4a3a-8619-47d784ae88c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Flow 'volume_create_manager' (d1de3c0b-f022-46e3-98da-a0935887df0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:47 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-c1e9e814-7521-4b33-9a0f-b33ff9e05a65 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created volume successfully. Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-219c358d-c219-4806-aee0-63cc7993f75c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-219c358d-c219-4806-aee0-63cc7993f75c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-219c358d-c219-4806-aee0-63cc7993f75c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:47 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-219c358d-c219-4806-aee0-63cc7993f75c" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:48 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc4a1f9-82d3-489c-b3da-a23d1b413664]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:48 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c Jun 29 03:25:48 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:48 devstack sudo[114821]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c 1073741824" returned: 0 in 1.047s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:48 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:25:48 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:48 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c" returned: 0 in 0.832s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:48 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:48 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c Jun 29 03:25:48 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:49 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 0.697s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0244577-6b66-4aca-b3e0-70f2fdaa2581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09afbbe74f4147298b6b182eff20816e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:37Z,use_quota=True,user_id='43234a31939f4b91bfb6b47c34cb1c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Creating volume c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:49 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:49 devstack sudo[114838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 1073741824 Jun 29 03:25:49 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f10cd5b-fbba-4bab-9ddd-8df4f864b125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4637ee3f-32c5-494c-ae82-a03167e3362c', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5219d212-61ad-4341-b8f8-15bf99b86ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:49 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Volume volume-4637ee3f-32c5-494c-ae82-a03167e3362c (4637ee3f-32c5-494c-ae82-a03167e3362c): created successfully Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5219d212-61ad-4341-b8f8-15bf99b86ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Flow 'volume_create_manager' (3c102d82-e44c-42da-bee0-54e661dc1439) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:49 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cb91d0a5-019d-458e-936d-93e66268a5d8 tempest-VolumeDependencyTests-1831908410 None] Created volume successfully. Jun 29 03:25:49 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-219c358d-c219-4806-aee0-63cc7993f75c" returned: 0 in 0.707s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-219c358d-c219-4806-aee0-63cc7993f75c" released by "delete_volume" :: held 1.611s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['e9500a9d-ea0c-4ba7-9ac9-091ec39cdbe5', '04ee2681-c3b2-4b01-8e25-976be22dda8f', '129722cf-1a80-49bf-88be-0b64604d8370', '934a0fc5-6280-4e68-b1a2-c387ae31a5a7'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:49 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:49 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:49 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-49753997-d33c-47f8-8468-75eb6ffca6a2-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-49753997-d33c-47f8-8468-75eb6ffca6a2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-49753997-d33c-47f8-8468-75eb6ffca6a2" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-49753997-d33c-47f8-8468-75eb6ffca6a2" acquired by "delete_volume" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a0d3e2-5ae8-4fd0-a01e-a412d0f16022]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:50 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 1073741824" returned: 0 in 1.135s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:50 devstack sudo[114846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 Jun 29 03:25:50 devstack sudo[114846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:50 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.779s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:50 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:25:50 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:50 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleted volume successfully. Jun 29 03:25:50 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-ab9a3634-75e1-4e28-8422-ad88b8bb1c0e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-219c358d-c219-4806-aee0-63cc7993f75c-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:51 devstack sudo[114846]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2" returned: 0 in 0.955s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:51 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 0 in 0.814s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:51 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2 Jun 29 03:25:51 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.496s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Creating offline snapshot 351a5f1c-da89-4e39-b35f-1c3ff12a485f of volume 4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Attempting download of 12b2e6f6-f41b-49ca-b031-981dd81e55ff ((None, [{'url': 'file:///opt/stack/data/glance/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'metadata': {}}])) to volume c0244577-6b66-4aca-b3e0-70f2fdaa2581. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[e186812b-31a7-4886-944b-fbe7a196cbc2]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad46b1a4-863a-4e5d-ab12-1f3b06fade62]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:51 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:51 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:25:51 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:51 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof Jun 29 03:25:51 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:52 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-49753997-d33c-47f8-8468-75eb6ffca6a2" returned: 0 in 0.811s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-49753997-d33c-47f8-8468-75eb6ffca6a2" released by "delete_volume" :: held 1.836s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['124be938-c3c9-454f-b518-9412633d1cc5', '16acedac-d10e-4365-9125-aaacc44faf85', '8c729923-7c0f-4fc6-8635-3dac72488d4c', 'ab2ac60a-d1cf-4f12-8e2f-0b27df9f20a9'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:52 devstack sudo[114868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:52 devstack sudo[114868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:52 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 0.992s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:52 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f 1G Jun 29 03:25:52 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-28f89b43-ef37-4b19-8dcb-699a596d1cbb-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:52 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof" returned: 0 in 1.121s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-28f89b43-ef37-4b19-8dcb-699a596d1cbb-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-28f89b43-ef37-4b19-8dcb-699a596d1cbb" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-28f89b43-ef37-4b19-8dcb-699a596d1cbb" acquired by "delete_volume" :: waited 0.038s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d92aa8-d386-4c0f-a39f-b26430ceb8c3]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:52 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:52 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof Jun 29 03:25:52 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:52 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb Jun 29 03:25:52 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:53 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f 1G" returned: 0 in 1.235s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4637ee3f-32c5-494c-ae82-a03167e3362c -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:53 devstack sudo[114880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4637ee3f-32c5-494c-ae82-a03167e3362c -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f Jun 29 03:25:53 devstack sudo[114880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:53 devstack sudo[114868]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.346s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:53 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleted volume successfully. Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-abe233af-8f75-4bda-b8fe-a420a21da6a0 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-49753997-d33c-47f8-8468-75eb6ffca6a2-delete_volume" released by "delete_volume" :: held 3.539s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:53 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof" returned: 1 in 1.249s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12b2e6f6-f41b-49ca-b031-981dd81e55ff_mey14dof' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[655e9d9e-cbc4-4373-92dc-edc122f3f20c]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:53 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:54 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD Jun 29 03:25:54 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:54 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb" returned: 0 in 1.231s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:54 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb Jun 29 03:25:54 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:54 devstack sudo[114880]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4637ee3f-32c5-494c-ae82-a03167e3362c -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f" returned: 0 in 0.883s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:54 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f is being set with open permissions: ugo+rw Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:54 devstack sudo[114896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f Jun 29 03:25:54 devstack sudo[114896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:54 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:54 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-28f89b43-ef37-4b19-8dcb-699a596d1cbb" returned: 0 in 0.786s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-28f89b43-ef37-4b19-8dcb-699a596d1cbb" released by "delete_volume" :: held 2.103s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=154,cinder:UPDATE=200,cinder:DELETE=19,cinder:INSERT=52 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:25:54 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD Jun 29 03:25:54 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:54 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['8c3bb6f6-2635-4f96-99a0-2351ec6b75a6', '80c722aa-14c2-4fc9-9098-da86110d3ba7', 'b32e1f15-8fd2-4776-ab3a-e0a42c47380b', 'ce4751e1-cc8d-415a-8899-fb73276cecab'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:UPDATE=212,cinder:SELECT=143,cinder:INSERT=53,cinder:DELETE=20 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:55 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:55 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:55 devstack sudo[114896]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f" returned: 0 in 0.803s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:55 devstack sudo[114906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info Jun 29 03:25:55 devstack sudo[114906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:55 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD" returned: 1 in 0.923s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] 12b2e6f6-f41b-49ca-b031-981dd81e55ff was raw, converting to raw {{(pid=93518) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:55 devstack sudo[114911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:25:55 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:55 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.747s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:55 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleted volume successfully. Jun 29 03:25:55 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-f464cc3f-b937-4f50-9894-784db33c8d76 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-28f89b43-ef37-4b19-8dcb-699a596d1cbb-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-4d217ca7-3219-450b-8ab0-6d9709ff6542-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-4d217ca7-3219-450b-8ab0-6d9709ff6542-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-4d217ca7-3219-450b-8ab0-6d9709ff6542" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-4d217ca7-3219-450b-8ab0-6d9709ff6542" acquired by "delete_volume" :: waited 0.027s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3d49b4-83e6-409a-9eda-480182a347ef]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:56 devstack sudo[114906]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info" returned: 0 in 1.029s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:56 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info is being set with open permissions: ugo+rw Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:56 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info Jun 29 03:25:56 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:56 devstack sudo[114915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 Jun 29 03:25:56 devstack sudo[114915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:56 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 0 in 1.090s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12b2e6f6-f41b-49ca-b031-981dd81e55ff_s7atw5pddevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:25:56 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Converted 0.00 MB image at 0.00 MB/s Jun 29 03:25:56 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:56 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 1G Jun 29 03:25:56 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:57 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.info" returned: 0 in 0.828s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.909s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:57 devstack sudo[114915]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:57 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-2875768a-55de-43d9-83a7-489bb72fbc9f tempest-VolumeDependencyTests-1831908410 None] Create snapshot completed successfully Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542" returned: 0 in 0.965s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:57 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542 Jun 29 03:25:57 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:57 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 1G" returned: 0 in 0.982s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[4066dd6f-21db-4e64-98f4-3e882df9d31f]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:57 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:57 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:25:57 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:58 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4d217ca7-3219-450b-8ab0-6d9709ff6542" returned: 0 in 0.892s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-4d217ca7-3219-450b-8ab0-6d9709ff6542" released by "delete_volume" :: held 1.940s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['dd2eb143-fdf5-4bc0-a324-1a5bac4bbfaf', 'bbb5d7e9-0290-4b25-b30c-df3dc65e35fd', '64852cc3-5b90-4a5e-a885-01c777a65a0e', '5af278ab-0773-4b8d-9f37-f281d5018e5a'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:58 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:25:58 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-386056d8-12b7-4498-9ece-673c9578041e-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-386056d8-12b7-4498-9ece-673c9578041e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-386056d8-12b7-4498-9ece-673c9578041e" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-386056d8-12b7-4498-9ece-673c9578041e" acquired by "delete_volume" :: waited 0.020s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c361bd6e-4006-49f4-9938-34c4670ebad4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:58 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:58 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:59 devstack sudo[114940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e Jun 29 03:25:59 devstack sudo[114940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 0 in 1.169s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:59 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:25:59 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Flow 'volume_create_manager' (280573e1-917f-486c-b5a6-3b2c7263f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1921cb6c-4d69-42b2-92a4-fd56b0445f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1921cb6c-4d69-42b2-92a4-fd56b0445f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1852092807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0034cf2d-36f0-4657-8d04-f5ce3774b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a942f803ea34a2cae38556cf47b1aaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=351a5f1c-da89-4e39-b35f-1c3ff12a485f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:25:59Z,use_quota=True,user_id='34097c263a7d409fbce0b44e24739411',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ce3be4-ad74-4a0f-81a7-4782aad9aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ce3be4-ad74-4a0f-81a7-4782aad9aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb981762-02b8-4d6e-9611-002bc75b0a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb981762-02b8-4d6e-9611-002bc75b0a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0034cf2d-36f0-4657-8d04-f5ce3774b17c', 'volume_name': 'volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c', 'volume_size': 1, 'snapshot_id': '351a5f1c-da89-4e39-b35f-1c3ff12a485f'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28c6f6-df94-486e-8bb0-4ca303ce8381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28c6f6-df94-486e-8bb0-4ca303ce8381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9b1b2b-c04b-4270-b617-627909bfbf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:25:59 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Volume 0034cf2d-36f0-4657-8d04-f5ce3774b17c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c', 'volume_size': 1, 'snapshot_id': '351a5f1c-da89-4e39-b35f-1c3ff12a485f'} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-quobyte-351a5f1c-da89-4e39-b35f-1c3ff12a485f-0034cf2d-36f0-4657-8d04-f5ce3774b17c" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-351a5f1c-da89-4e39-b35f-1c3ff12a485f-0034cf2d-36f0-4657-8d04-f5ce3774b17c" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Creating volume 0034cf2d-36f0-4657-8d04-f5ce3774b17c from snapshot 351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-quobyte-0034cf2d-36f0-4657-8d04-f5ce3774b17c" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-0034cf2d-36f0-4657-8d04-f5ce3774b17c" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] snapshot: 351a5f1c-da89-4e39-b35f-1c3ff12a485f, volume: 0034cf2d-36f0-4657-8d04-f5ce3774b17c, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed9e47-1c24-4136-b94f-43a1bb0d642a]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:25:59 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.275s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:25:59 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleted volume successfully. Jun 29 03:25:59 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-61117847-042f-4deb-bfa4-46b063acce96 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-4d217ca7-3219-450b-8ab0-6d9709ff6542-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:25:59 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f Jun 29 03:25:59 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:00 devstack sudo[114940]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e" returned: 0 in 1.519s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:00 devstack sudo[114954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e Jun 29 03:26:00 devstack sudo[114954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:00 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 1 in 1.589s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Downloaded image 12b2e6f6-f41b-49ca-b031-981dd81e55ff ((None, [{'url': 'file:///opt/stack/data/glance/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'metadata': {}}])) to volume c0244577-6b66-4aca-b3e0-70f2fdaa2581 successfully. {{(pid=93518) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Temporary image 12b2e6f6-f41b-49ca-b031-981dd81e55ff for user 43234a31939f4b91bfb6b47c34cb1c17 is deleted. {{(pid=93518) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.volume_utils [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Marking volume c0244577-6b66-4aca-b3e0-70f2fdaa2581 as bootable. {{(pid=93518) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Copying metadata from image 12b2e6f6-f41b-49ca-b031-981dd81e55ff to c0244577-6b66-4aca-b3e0-70f2fdaa2581. {{(pid=93518) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Creating volume glance metadata for volume c0244577-6b66-4aca-b3e0-70f2fdaa2581 backed by image 12b2e6f6-f41b-49ca-b031-981dd81e55ff with: {'image_id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2e2d2e0fece7b9fd27259dfdcf513b00', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93518) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52f77f9-a082-4c93-9c16-daa977e0b921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581', 'volume_size': 1, 'image_id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e2d2e0fece7b9fd27259dfdcf513b00', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '09afbbe74f4147298b6b182eff20816e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15894ed6753dbc9ae2a38d7c15c9f7a0fa0ca4cf4b1d9290854cf94a08c18155b2e5bb35d337b07a0955379795a304eb4a14afb1120c26af9834a52b496e8445', 'id': '12b2e6f6-f41b-49ca-b031-981dd81e55ff', 'created_at': datetime.datetime(2026, 6, 29, 1, 25, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 29, 1, 25, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12b2e6f6-f41b-49ca-b031-981dd81e55ff/file', 'properties': {}}, 'image_service': }' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84299136-3ff1-4dc2-935d-5f15aafe4fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:00 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Volume volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 (c0244577-6b66-4aca-b3e0-70f2fdaa2581): created successfully Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84299136-3ff1-4dc2-935d-5f15aafe4fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Flow 'volume_create_manager' (8cad64b9-249c-40af-9929-c8288cce68e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:00 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-787e26fa-8ed1-45c2-87a8-e808eedd1e34 tempest-VolumeImageDependencyTests-930594090 None] Created volume successfully. Jun 29 03:26:00 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f" returned: 0 in 1.293s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4637ee3f-32c5-494c-ae82-a03167e3362c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[00311142-9274-411d-ace6-955e1741bf10]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:00 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:01 devstack sudo[114960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:26:01 devstack sudo[114960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:01 devstack sudo[114954]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-386056d8-12b7-4498-9ece-673c9578041e" returned: 0 in 1.060s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-386056d8-12b7-4498-9ece-673c9578041e" released by "delete_volume" :: held 2.639s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['99ccad92-3f66-4767-9208-9413fc37e9a9', 'dab8475c-6c36-4af5-8bf2-4bf95d24d29e', 'cf7ffcac-beae-413a-a93f-697301fd6cc0', '9aaaa99f-15fe-4cbb-a7ce-05d7b9748a0c'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:01 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:01 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Acquiring lock "cinder-c0244577-6b66-4aca-b3e0-70f2fdaa2581-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Lock "cinder-c0244577-6b66-4aca-b3e0-70f2fdaa2581-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Acquiring lock "cinder-quobyte-c0244577-6b66-4aca-b3e0-70f2fdaa2581" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:01 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Lock "cinder-quobyte-c0244577-6b66-4aca-b3e0-70f2fdaa2581" acquired by "delete_volume" :: waited 0.039s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bec3fae-2442-4962-9fc4-b2f37f8ac86f]: (4, 'raw') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleting offline snapshot ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead of volume f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] snapshot_file for this snap is: volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:26:02 devstack sudo[114960]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 1.251s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[83377fd8-5f37-4f5f-8b3e-bd1d741ec5d9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:02 devstack sudo[114968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:26:02 devstack sudo[114968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:02 devstack sudo[114970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c Jun 29 03:26:02 devstack sudo[114970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:02 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead Jun 29 03:26:02 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:02 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.953s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:02 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleted volume successfully. Jun 29 03:26:02 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-b48d2ab0-5609-41d8-bc86-605157bcc69e tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-386056d8-12b7-4498-9ece-673c9578041e-delete_volume" released by "delete_volume" :: held 3.892s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:03 devstack sudo[114968]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 0 in 1.308s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:03 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" returned: 0 in 1.260s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:03 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:03 devstack sudo[114984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:26:03 devstack sudo[114984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:03 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8178fd-fc57-4207-b6fe-217072f13587]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:03 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:03 devstack sudo[114992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d Jun 29 03:26:03 devstack sudo[114992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:05 devstack sudo[114984]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 1 in 2.114s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581' failed. Not Retrying. {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 29 03:26:05 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:05 devstack sudo[114998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581 Jun 29 03:26:05 devstack sudo[114998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:06 devstack sudo[114992]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" returned: 0 in 2.536s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:06 devstack sudo[115003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead Jun 29 03:26:06 devstack sudo[115003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Flow 'volume_create_manager' (df910f5e-3f75-4aee-92db-34500c587a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a9740-d6d8-433e-bcbc-1c687337867d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e97a9740-d6d8-433e-bcbc-1c687337867d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2038410833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c76617-4ad5-4f86-a249-642aca0e2f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db6c06eb12248c7a0ae5ac8015aab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:06Z,use_quota=True,user_id='17fe6229fb0649788c15c5835e712774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db29f1b7-8f64-48b9-b3cc-c01f235a423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db29f1b7-8f64-48b9-b3cc-c01f235a423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450d9a76-3a5f-45d6-badf-da7da5594ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450d9a76-3a5f-45d6-badf-da7da5594ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c76617-4ad5-4f86-a249-642aca0e2f1f', 'volume_name': 'volume-60c76617-4ad5-4f86-a249-642aca0e2f1f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4be0a4-814e-4b64-badc-f59f1fe1ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da4be0a4-814e-4b64-badc-f59f1fe1ee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4193980d-8439-4d0b-95af-d0d3d14221ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:06 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Volume 60c76617-4ad5-4f86-a249-642aca0e2f1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c76617-4ad5-4f86-a249-642aca0e2f1f', 'volume_size': 1} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:06 devstack sudo[114998]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c0244577-6b66-4aca-b3e0-70f2fdaa2581" returned: 0 in 1.450s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:06 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Lock "cinder-quobyte-c0244577-6b66-4aca-b3e0-70f2fdaa2581" released by "delete_volume" :: held 5.024s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Created reservations ['b12b8653-10e7-47d1-981e-8d5f9f4aecfe', 'a7f22db9-181d-4c9f-bd9f-411016c8376b', '1c99f732-4c80-4119-a130-e6e12859934b', 'b60d445e-8833-4b57-b58e-63244e7525db'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:07 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:07 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:07 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:08 devstack sudo[115003]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" returned: 0 in 2.146s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:08 devstack sudo[115013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead Jun 29 03:26:08 devstack sudo[115013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:08 devstack sudo[114970]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c" returned: 0 in 6.380s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:08 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca3aa63-bced-46e6-ae28-9afdd3254d58]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 1.334s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:08 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Deleted volume successfully. Jun 29 03:26:08 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-7a4ef846-4b68-4ce7-9bf9-281d4ed8d45a tempest-VolumeImageDependencyTests-930594090 None] Lock "cinder-c0244577-6b66-4aca-b3e0-70f2fdaa2581-delete_volume" released by "delete_volume" :: held 6.951s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:08 devstack sudo[115016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:26:08 devstack sudo[115016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:09 devstack sudo[115013]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d.ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" returned: 0 in 0.836s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead" released by "_delete_snapshot" :: held 7.017s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" released by "delete_snapshot" :: held 7.047s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['210000b2-683c-4365-ba33-960c52a14c9b', 'f58410d5-6cec-42ab-8ad5-d262197bec8c', '45870116-a7b1-4158-8e67-36b3dd59fd0d', '1c7c93af-c0f6-4654-ba1d-b905f1f03ca5'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:09 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Delete snapshot completed successfully. Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-4b46146a-be69-45c3-959f-3689b1ff2e32 tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-ec5f9f0e-808b-4c50-82b9-2e7a0d6f0ead-delete_snapshot" released by "delete_snapshot" :: held 7.297s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-f6d96342-178e-40a5-8bc2-8e1c7507ad5d-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-f6d96342-178e-40a5-8bc2-8e1c7507ad5d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:09 devstack sudo[115016]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 1.113s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:26:09 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Converted 1024.00 MB image at 160.43 MB/s Jun 29 03:26:09 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c is being set with open permissions: ugo+rw Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "cinder-quobyte-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:09 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c Jun 29 03:26:09 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6e5c3-c867-4dc7-8e52-7db2c8061c14]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:09 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:09 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d Jun 29 03:26:09 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:10 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c" returned: 0 in 0.707s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-0034cf2d-36f0-4657-8d04-f5ce3774b17c" released by "_copy_volume_from_snapshot" :: held 10.894s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-351a5f1c-da89-4e39-b35f-1c3ff12a485f-0034cf2d-36f0-4657-8d04-f5ce3774b17c" released by "_create_volume_from_snapshot" :: held 10.932s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.955s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.888s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2038410833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c76617-4ad5-4f86-a249-642aca0e2f1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db6c06eb12248c7a0ae5ac8015aab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:06Z,use_quota=True,user_id='17fe6229fb0649788c15c5835e712774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)}" {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Creating volume 60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:10 devstack cinder-volume[93518]: INFO cinder.volume.drivers.remotefs [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] casted to osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f 1073741824 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:10 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f 1073741824 Jun 29 03:26:10 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd9b1b2b-c04b-4270-b617-627909bfbf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c', 'volume_size': 1, 'snapshot_id': '351a5f1c-da89-4e39-b35f-1c3ff12a485f'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a631c32-9e05-4ff8-8919-020590a05d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:10 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Volume volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c (0034cf2d-36f0-4657-8d04-f5ce3774b17c): created successfully Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a631c32-9e05-4ff8-8919-020590a05d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Flow 'volume_create_manager' (280573e1-917f-486c-b5a6-3b2c7263f94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:10 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-cff8a145-9b16-4267-a466-10dd99025ba9 tempest-VolumeDependencyTests-1831908410 None] Created volume successfully. Jun 29 03:26:10 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" returned: 0 in 0.821s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:10 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:10 devstack sudo[115032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d Jun 29 03:26:10 devstack sudo[115032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:11 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:11 devstack sudo[115032]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f 1073741824" returned: 0 in 0.854s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" returned: 0 in 0.705s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-quobyte-f6d96342-178e-40a5-8bc2-8e1c7507ad5d" released by "delete_volume" :: held 1.596s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:11 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:11 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Created reservations ['3445b5f6-ecd9-4371-a487-41cde5f7e7cc', '40bd39be-b14a-4c47-86ec-b73cb9f77faa', 'b292ae14-24af-4aed-85aa-ff010f7843a5', '14719ce1-d302-447a-8913-3a105727f372'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:11 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:11 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-351a5f1c-da89-4e39-b35f-1c3ff12a485f-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-351a5f1c-da89-4e39-b35f-1c3ff12a485f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-quobyte-4637ee3f-32c5-494c-ae82-a03167e3362c" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-4637ee3f-32c5-494c-ae82-a03167e3362c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-quobyte-351a5f1c-da89-4e39-b35f-1c3ff12a485f" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-351a5f1c-da89-4e39-b35f-1c3ff12a485f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Deleting offline snapshot 351a5f1c-da89-4e39-b35f-1c3ff12a485f of volume 4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] snapshot_file for this snap is: volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40e0c1a-856b-4158-91e4-ff2129458dfb]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:11 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:11 devstack sudo[115043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f Jun 29 03:26:11 devstack sudo[115043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:12 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'} {{(pid=93518) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4193980d-8439-4d0b-95af-d0d3d14221ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c76617-4ad5-4f86-a249-642aca0e2f1f', 'volume_size': 1}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a55a97-79a4-4b07-9f29-80c7d7e29ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:12 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Volume volume-60c76617-4ad5-4f86-a249-642aca0e2f1f (60c76617-4ad5-4f86-a249-642aca0e2f1f): created successfully Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a55a97-79a4-4b07-9f29-80c7d7e29ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Flow 'volume_create_manager' (df910f5e-3f75-4aee-92db-34500c587a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-207d36d4-9f29-4dea-b6fe-8a2ca94c2193 tempest-SnapshotDependencyTests-1095124402 None] Created volume successfully. Jun 29 03:26:12 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.758s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:12 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Deleted volume successfully. Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-d645f9db-c8a5-49e9-9fdc-39ca48242bfc tempest-CreateVolumesFromSnapshotTest-1350162275 None] Lock "cinder-f6d96342-178e-40a5-8bc2-8e1c7507ad5d-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:12 devstack sudo[115043]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f" returned: 0 in 0.915s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4637ee3f-32c5-494c-ae82-a03167e3362c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[94041808-433f-43d7-94c6-f94a54feec71]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Creating offline snapshot 9c288123-fb17-4c07-b706-80ad5b6ce345 of volume 60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a0b21-b7ba-4b2b-b1cc-33d9268aab77]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:12 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:12 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:26:12 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:12 devstack sudo[115051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:12 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:13 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:13 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 0.882s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.844s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:13 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 1G {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:13 devstack sudo[115060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f Jun 29 03:26:13 devstack sudo[115060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:13 devstack sudo[115061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 1G Jun 29 03:26:13 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:14 devstack sudo[115060]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f" returned: 0 in 0.779s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:14 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f Jun 29 03:26:14 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:14 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 1G" returned: 0 in 0.809s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c76617-4ad5-4f86-a249-642aca0e2f1f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:14 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c76617-4ad5-4f86-a249-642aca0e2f1f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 Jun 29 03:26:14 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:14 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:14 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c.351a5f1c-da89-4e39-b35f-1c3ff12a485f" returned: 0 in 0.641s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-351a5f1c-da89-4e39-b35f-1c3ff12a485f" released by "_delete_snapshot" :: held 3.369s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-4637ee3f-32c5-494c-ae82-a03167e3362c" released by "delete_snapshot" :: held 3.402s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:15 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60c76617-4ad5-4f86-a249-642aca0e2f1f -F qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345" returned: 0 in 0.687s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:15 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 is being set with open permissions: ugo+rw Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:15 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 Jun 29 03:26:15 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Created reservations ['c3fe8a73-b588-43c1-9a6c-b415ab0aeb06', '042b7065-4bbe-4a4b-b7c2-09903f80c16a', '385e580c-bcf1-4165-ad22-0e74151bab82', '062a72a9-1919-4e24-b361-374cd57f3246'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:15 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Delete snapshot completed successfully. Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-814a93dc-1c31-49c3-989b-6705d2dfba0e tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-351a5f1c-da89-4e39-b35f-1c3ff12a485f-delete_snapshot" released by "delete_snapshot" :: held 3.561s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:15 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345" returned: 0 in 0.663s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:15 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info Jun 29 03:26:15 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-4637ee3f-32c5-494c-ae82-a03167e3362c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-4637ee3f-32c5-494c-ae82-a03167e3362c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-quobyte-4637ee3f-32c5-494c-ae82-a03167e3362c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-4637ee3f-32c5-494c-ae82-a03167e3362c" acquired by "delete_volume" :: waited 0.023s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a77f67-2968-4d60-9136-c35e094f5eec]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:15 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:16 devstack sudo[115084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:26:16 devstack sudo[115084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:16 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info" returned: 0 in 0.669s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:16 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info is being set with open permissions: ugo+rw Jun 29 03:26:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:16 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info Jun 29 03:26:16 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:16 devstack sudo[115084]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 0.793s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:16 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:16 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c Jun 29 03:26:16 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:17 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.info" returned: 0 in 0.637s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.446s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:17 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-e5895a74-cb82-4aa0-a5f2-3f44e3b5b09c tempest-SnapshotDependencyTests-1095124402 None] Create snapshot completed successfully Jun 29 03:26:17 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-4637ee3f-32c5-494c-ae82-a03167e3362c" returned: 0 in 0.629s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-4637ee3f-32c5-494c-ae82-a03167e3362c" released by "delete_volume" :: held 1.478s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Created reservations ['728119ab-9b31-4668-8ad7-4e195fca625d', 'c33521c0-ce2a-4fa6-9ad3-01997cbd426f', 'f153681e-6952-49bb-905d-c19cd68e16bb', 'ddf38be6-e416-4b2c-9ab2-a907e53cee34'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:17 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:17 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:17 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:17 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:17 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-0034cf2d-36f0-4657-8d04-f5ce3774b17c-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-0034cf2d-36f0-4657-8d04-f5ce3774b17c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "cinder-quobyte-0034cf2d-36f0-4657-8d04-f5ce3774b17c" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-0034cf2d-36f0-4657-8d04-f5ce3774b17c" acquired by "delete_volume" :: waited 0.018s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:18 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.725s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:18 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Deleted volume successfully. Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[234e2db3-78a3-4dba-a182-1387ba153f73]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-09d5f09e-953f-4be2-a29d-8648bf7a5560 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-4637ee3f-32c5-494c-ae82-a03167e3362c-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:18 devstack sudo[115103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c Jun 29 03:26:18 devstack sudo[115103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:18 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.767s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_service.periodic_task [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] Running periodic task VolumeManager._thread_info {{(pid=93518) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread count: 28 {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-15ad846e-d565-45c4-9edf-3b943e3deef6 None None] thread info: [<_MainThread(MainThread, started 132475643015296)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93518) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93518) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Flow 'volume_create_manager' (be6fa0b7-b4bc-4353-8438-5c759077e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7175b5-f5d7-49bb-a427-b0cfea2e003f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7175b5-f5d7-49bb-a427-b0cfea2e003f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-29T01:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b79f84-afd0-4c49-88b6-a75e66a9edfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db6c06eb12248c7a0ae5ac8015aab18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-29T01:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9c288123-fb17-4c07-b706-80ad5b6ce345,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-29T01:26:19Z,use_quota=True,user_id='17fe6229fb0649788c15c5835e712774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b9ff019-744f-409d-8dc0-bb158e4eb7e5),volume_type_id=9b9ff019-744f-409d-8dc0-bb158e4eb7e5)' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c780f0f-6bed-4179-b25b-906afe01e2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c780f0f-6bed-4179-b25b-906afe01e2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb4d22a-4168-414d-a98c-20544b1295c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb4d22a-4168-414d-a98c-20544b1295c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c6b79f84-afd0-4c49-88b6-a75e66a9edfa', 'volume_name': 'volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa', 'volume_size': 1, 'snapshot_id': '9c288123-fb17-4c07-b706-80ad5b6ce345'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5adcd9f-f39c-4f4b-ad78-14062616cf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5adcd9f-f39c-4f4b-ad78-14062616cf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a78a06c-a81e-433d-9efc-52812e5d0565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:18 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Volume c6b79f84-afd0-4c49-88b6-a75e66a9edfa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa', 'volume_size': 1, 'snapshot_id': '9c288123-fb17-4c07-b706-80ad5b6ce345'} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-quobyte-9c288123-fb17-4c07-b706-80ad5b6ce345-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" by "_create_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-9c288123-fb17-4c07-b706-80ad5b6ce345-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Creating volume c6b79f84-afd0-4c49-88b6-a75e66a9edfa from snapshot 9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Selected osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c as target Quobyte volume. {{(pid=93518) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-quobyte-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" by "_copy_volume_from_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] snapshot: 9c288123-fb17-4c07-b706-80ad5b6ce345, volume: c6b79f84-afd0-4c49-88b6-a75e66a9edfa, {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e209f6-45ca-4ceb-bdc2-68fc3612cff7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:18 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:18 devstack sudo[115106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 Jun 29 03:26:18 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:19 devstack sudo[115103]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c" returned: 0 in 0.826s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:19 devstack sudo[115111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c Jun 29 03:26:19 devstack sudo[115111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:19 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345" returned: 0 in 0.777s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c76617-4ad5-4f86-a249-642aca0e2f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Creating direct copy from snapshot {{(pid=93518) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb7cfb9-4850-40d7-8bc7-7acdb68b4754]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:19 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:19 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:19 devstack sudo[115111]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-0034cf2d-36f0-4657-8d04-f5ce3774b17c" returned: 0 in 0.641s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-quobyte-0034cf2d-36f0-4657-8d04-f5ce3774b17c" released by "delete_volume" :: held 1.525s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Created reservations ['fd8290d8-5836-43b8-9ec1-882f432aac85', 'a1c85712-bec7-46a9-9a69-0f8fad90707c', 'bf11933b-11c5-43bd-9fd1-c310689df44c', '643aee7d-48a5-4ab8-b30b-2527a8eb5b66'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:19 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:19 devstack sudo[115119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:19 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:20 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.786s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:20 devstack cinder-volume[93518]: DEBUG cinder.utils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Path /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa not found in is_blk_device check {{(pid=93518) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 29 03:26:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:20 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa Jun 29 03:26:20 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:20 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:20 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.655s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:20 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:20 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Deleted volume successfully. Jun 29 03:26:20 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-72bb84b2-ef62-4d35-a860-4fad4505ca15 tempest-VolumeDependencyTests-1831908410 None] Lock "cinder-0034cf2d-36f0-4657-8d04-f5ce3774b17c-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:25 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" returned: 0 in 4.797s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:25 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b214b-c2c4-463c-b147-21c1db193c96]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:25 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:25 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:25 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:26 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.938s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.image.image_utils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Image conversion details: src /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa {{(pid=93518) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 29 03:26:26 devstack cinder-volume[93518]: INFO cinder.image.image_utils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Converted 1024.00 MB image at 213.44 MB/s Jun 29 03:26:26 devstack cinder-volume[93518]: WARNING cinder.volume.drivers.remotefs [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa is being set with open permissions: ugo+rw Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:26 devstack sudo[115153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa Jun 29 03:26:26 devstack sudo[115153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:26 devstack sudo[115153]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" returned: 0 in 0.645s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" released by "_copy_volume_from_snapshot" :: held 8.036s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-9c288123-fb17-4c07-b706-80ad5b6ce345-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" released by "_create_volume_from_snapshot" :: held 8.070s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.085s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a78a06c-a81e-433d-9efc-52812e5d0565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa', 'volume_size': 1, 'snapshot_id': '9c288123-fb17-4c07-b706-80ad5b6ce345'}' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f2839-192a-4143-b122-f9887a7a0c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 29 03:26:26 devstack cinder-volume[93518]: INFO cinder.volume.flows.manager.create_volume [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Volume volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa (c6b79f84-afd0-4c49-88b6-a75e66a9edfa): created successfully Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (612f2839-192a-4143-b122-f9887a7a0c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93518) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 29 03:26:26 devstack cinder-volume[93518]: DEBUG cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Flow 'volume_create_manager' (be6fa0b7-b4bc-4353-8438-5c759077e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93518) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 29 03:26:26 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-1b60ccbf-1c21-4d81-80d5-0a808e180d39 tempest-SnapshotDependencyTests-1095124402 None] Created volume successfully. Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-9c288123-fb17-4c07-b706-80ad5b6ce345-delete_snapshot" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-9c288123-fb17-4c07-b706-80ad5b6ce345-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-quobyte-60c76617-4ad5-4f86-a249-642aca0e2f1f" by "delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-60c76617-4ad5-4f86-a249-642aca0e2f1f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-quobyte-9c288123-fb17-4c07-b706-80ad5b6ce345" by "_delete_snapshot" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-9c288123-fb17-4c07-b706-80ad5b6ce345" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Deleting offline snapshot 9c288123-fb17-4c07-b706-80ad5b6ce345 of volume 60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] snapshot_file for this snap is: volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca7676b-da91-464f-a31f-deefc9015bc9]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:27 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:27 devstack sudo[115156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 Jun 29 03:26:27 devstack sudo[115156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:28 devstack sudo[115156]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345" returned: 0 in 0.800s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:28 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.remotefs [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60c76617-4ad5-4f86-a249-642aca0e2f1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93518) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 29 03:26:28 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f1316b-a1cf-4aa0-87cd-a228d05ba445]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:28 devstack sudo[115162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:28 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:28 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.749s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:28 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:28 devstack sudo[115167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 Jun 29 03:26:28 devstack sudo[115167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:29 devstack sudo[115167]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345" returned: 0 in 0.746s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:29 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:29 devstack sudo[115172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345 Jun 29 03:26:29 devstack sudo[115172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:30 devstack sudo[115172]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:30 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f.9c288123-fb17-4c07-b706-80ad5b6ce345" returned: 0 in 0.624s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-9c288123-fb17-4c07-b706-80ad5b6ce345" released by "_delete_snapshot" :: held 3.012s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-60c76617-4ad5-4f86-a249-642aca0e2f1f" released by "delete_snapshot" :: held 3.034s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:30 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Created reservations ['fb9f233a-cb2f-4b48-a6ee-2574af2df7e8', '7e00713e-b5ca-4c80-91e1-450aedfdb0e1', 'bc418c99-9dc5-406a-b1aa-e98647ae9eaa', 'c628db6b-683e-4eb5-99b9-f3c1c79b79f8'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:30 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Delete snapshot completed successfully. Jun 29 03:26:30 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-927fe4b7-b833-42d6-9bb2-a258642cf7cf tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-9c288123-fb17-4c07-b706-80ad5b6ce345-delete_snapshot" released by "delete_snapshot" :: held 3.165s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-60c76617-4ad5-4f86-a249-642aca0e2f1f-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-60c76617-4ad5-4f86-a249-642aca0e2f1f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-quobyte-60c76617-4ad5-4f86-a249-642aca0e2f1f" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:31 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-60c76617-4ad5-4f86-a249-642aca0e2f1f" acquired by "delete_volume" :: waited 0.014s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:31 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37f462b-8559-4a0e-863f-e970e711b2c7]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:31 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:31 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:31 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:32 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.761s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:32 devstack sudo[115180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f Jun 29 03:26:32 devstack sudo[115180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:32 devstack sudo[115180]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:32 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-60c76617-4ad5-4f86-a249-642aca0e2f1f" returned: 0 in 0.640s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-60c76617-4ad5-4f86-a249-642aca0e2f1f" released by "delete_volume" :: held 1.456s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Created reservations ['9cbb8d9d-0bd3-4419-a877-db3e2aaf4f72', '72068141-c48d-491f-9d9b-964671946130', 'ac331b5b-b1bb-43c5-8c83-20556db902e5', 'f2f515b1-5cc1-4e56-9205-5b2976064670'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:33 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:33 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-c6b79f84-afd0-4c49-88b6-a75e66a9edfa-delete_volume" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:33 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.617s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-c6b79f84-afd0-4c49-88b6-a75e66a9edfa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:33 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Deleted volume successfully. Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-8dd58c6b-de54-4128-a19c-43c1d004b978 tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-60c76617-4ad5-4f86-a249-642aca0e2f1f-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "cinder-quobyte-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" by "delete_volume" {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" acquired by "delete_volume" :: waited 0.017s {{(pid=93518) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbe81d3-25b4-4f52-946d-c5c9187705d4]: (4, 'qcow2') {{(pid=94847) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 29 03:26:33 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:33 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa Jun 29 03:26:33 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:34 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" returned: 0 in 0.715s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:34 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:34 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa Jun 29 03:26:34 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:35 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788/volume-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" returned: 0 in 0.626s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-quobyte-c6b79f84-afd0-4c49-88b6-a75e66a9edfa" released by "delete_volume" :: held 1.382s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG cinder.quota [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Created reservations ['c7dccc67-9bb7-4952-b1b4-a22ba083e08c', '5e9b381d-a348-4310-8c72-a87c49b7d261', '52d26ae1-4d99-4bcb-be21-a5ab0a5888b1', '50126c50-5cf9-49b7-a8e3-023ad0c3e6dd'] {{(pid=93518) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c': None} {{(pid=93518) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG cinder.volume.drivers.quobyte [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-fb1bb66a-85f5-410b-abbf-ac3d23d0c79c'] {{(pid=93518) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.lockutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93518) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 29 03:26:35 devstack sudo[115194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788 Jun 29 03:26:35 devstack sudo[115194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 29 03:26:35 devstack sudo[115194]: pam_unix(sudo:session): session closed for user root Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG oslo_concurrency.processutils [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/523973c4254249fd6570952df3cbe788" returned: 0 in 0.638s {{(pid=93518) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG cinder.manager [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Notifying Schedulers of capabilities ... {{(pid=93518) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 29 03:26:35 devstack cinder-volume[93518]: INFO cinder.volume.manager [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Deleted volume successfully. Jun 29 03:26:35 devstack cinder-volume[93518]: DEBUG cinder.coordination [None req-dcc5a11f-3e7c-423b-90c6-8ad12781a2dc tempest-SnapshotDependencyTests-1095124402 None] Lock "cinder-c6b79f84-afd0-4c49-88b6-a75e66a9edfa-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=93518) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 29 03:26:45 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:SELECT=78,cinder:UPDATE=88,cinder:INSERT=29,cinder:DELETE=7 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 29 03:26:45 devstack cinder-volume[93518]: DEBUG dbcounter [-] [93518] Writing DB stats cinder:INSERT=28,cinder:UPDATE=109,cinder:SELECT=73,cinder:DELETE=8 {{(pid=93518) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}